Jun 23 15:44:04 devstack cinder-volume[82462]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 15:44:04 devstack cinder-volume[82462]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 15:44:04 devstack cinder-volume[82462]: we strongly recommend against using it for new projects. Jun 23 15:44:04 devstack cinder-volume[82462]: If you are already using Eventlet, we recommend migrating to a different Jun 23 15:44:04 devstack cinder-volume[82462]: framework. For more detail see Jun 23 15:44:04 devstack cinder-volume[82462]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 15:44:04 devstack cinder-volume[82462]: import eventlet # noqa Jun 23 15:44:06 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:44:06 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:44:06 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:44:07 devstack cinder-volume[82462]: INFO dbcounter [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Registered counter for database cinder Jun 23 15:44:07 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG dbcounter [-] [82462] Writer thread running {{(pid=82462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.rpc [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.rpc [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.volume.manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Determined volume DB was empty at startup. Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG cinder.volume.manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82462) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.volume.manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 15:44:08 devstack cinder-volume[82462]: WARNING stevedore.named [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 15:44:08 devstack cinder-volume[82462]: WARNING castellan.key_manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:44:08 devstack cinder-volume[82462]: WARNING cinder.keymgr.conf_key_mgr [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG cinder.volume.drivers.lvm [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82462) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_concurrency.processutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_concurrency.processutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] CMD "cinder-rtstool verify" returned: 0 in 0.417s {{(pid=82462) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.rpc [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.rpc [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 15:44:08 devstack cinder-volume[82462]: WARNING stevedore.named [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 15:44:08 devstack cinder-volume[82462]: WARNING castellan.key_manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:44:08 devstack cinder-volume[82462]: INFO cinder.volume.manager [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_db.sqlalchemy.engines [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:44:08 devstack cinder-volume[82462]: INFO oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Starting 1 workers Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Started child 82623 {{(pid=82462) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Full set of CONF: {{(pid=82462) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] ******************************************************************************** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Configuration options gathered from: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] ================================================================================ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] allow_availability_zone_fallback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] allow_compression_on_image_upload = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82623]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] allowed_direct_url_schemes = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] api_rate_limit = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] auth_strategy = keystone {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] az_cache_duration = 3600 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_host = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_stats_polling_interval = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backup_api_class = cinder.backup.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backup_name_template = backup-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backup_use_same_host = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backup_use_temp_snapshot = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] chap_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_internal_tenant_project_id = 14d7c3e985184094a5cb13bd95a424f7 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_internal_tenant_user_id = 38a5af4fd9b5436984e236230a6a338b {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cloned_volume_same_az = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cluster = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] compression_format = gzip {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] compute_api_class = cinder.compute.nova.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] config_dir = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] config_source = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] control_exchange = openstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] debug = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] default_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] default_group_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] default_volume_type = lvmdriver-1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_ssl_cert_verify = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] driver_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] enable_force_upload = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] enable_new_services = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] enable_unsupported_driver = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] enabled_backends = ['lvmdriver-1'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] enforce_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_api_insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_api_ssl_compression = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_ca_certificates_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_catalog_info = image:glance:publicURL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_num_retries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance_request_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] graceful_shutdown_timeout = 5 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] group_api_class = cinder.group.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] host = devstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_compress_on_upload = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_conversion_address_space_limit = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_conversion_cpu_limit = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_conversion_disable = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_upload_use_cinder_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_upload_use_internal_tenant = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_volume_cache_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_volume_cache_max_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] image_volume_cache_max_size_gb = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] init_host_max_objects_retrieval = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] instance_format = [instance: %(uuid)s] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iscsi_target_flags = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iscsi_write_cache = on {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iser_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iser_ip_address = 192.168.122.245 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iser_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_color = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_config_append = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_options = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_rotate_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_rotate_interval_type = days {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] log_rotation_type = none {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] max_age = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] max_logfile_count = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] max_logfile_size_mb = 200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] max_over_subscription_ratio = 20.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] message_reap_interval = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] message_ttl = 2592000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] migration_create_volume_timeout_secs = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] monkey_patch = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] monkey_patch_modules = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] my_ip = 192.168.122.245 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] no_snapshot_gb_quota = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] num_iser_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] num_shell_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] num_volume_device_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] nvmeof_conn_info_version = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] nvmet_ns_id = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] nvmet_port_id = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_max_limit = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_ext_list = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_listen = 0.0.0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_listen_port = 8776 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82623]: INFO cinder.volume.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] osapi_volume_workers = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] per_volume_size_limit = -1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] periodic_fuzzy_delay = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] periodic_interval = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] project_id_regex = [0-9a-f\-]+ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] public_endpoint = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] publish_errors = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_backup_gigabytes = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_backups = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_gigabytes = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_groups = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_snapshots = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] quota_volumes = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] rate_limit_burst = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] rate_limit_except_level = CRITICAL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] rate_limit_interval = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] reinit_driver_count = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] report_discard_supported = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] report_interval = 120 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] reservation_clean_interval = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] reservation_expire = 86400 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] reserved_image_namespaces = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] reserved_percentage = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] rpc_response_timeout = 120 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] run_external_periodic_tasks = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] scst_target_driver = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_down_time = 720 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] shell_completion = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] snapshot_name_template = snapshot-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] snapshot_same_host = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] state_path = /opt/stack/data/cinder {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] storage_availability_zone = nova {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] storage_protocol = iSCSI {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] syslog_log_facility = LOG_USER {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_helper = lioadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_ip_address = 192.168.122.245 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_protocol = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] target_secondary_ip_addresses = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] transfer_api_class = cinder.transfer.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] transport_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] until_refresh = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_chap_auth = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_default_quota_class = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_journal = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_json = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_stderr = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] use_syslog = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] verify_glance_signatures = enabled {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:08 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_api_class = cinder.volume.api.API {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_clear = zero {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_clear_size = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_copy_bps_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_dd_blocksize = 1M {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_name_template = volume-%s {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_service_inithost_offload = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volume_usage_audit_period = month {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] zoning_mode = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_concurrency.disable_process_locking = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.auth_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.cache = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.delay_auth_decision = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.http_connect_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.include_service_catalog = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.interface = public {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_password = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcache_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.service_token_roles_required = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.service_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.token_cache_time = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.backend = dogpile.cache.null {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.backend_argument = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.backend_expiration_time = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.config_prefix = cache.oslo {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.debug_cache_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.enable_retry_client = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.enable_socket_keepalive = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.expiration_time = 600 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.hashclient_retry_attempts = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_dead_retry = 300 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_pool_maxsize = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_sasl_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.proxies = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.redis_db = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.redis_sentinel_service_name = mymaster {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.redis_server = localhost:6379 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.retry_attempts = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.retry_delay = 0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.socket_keepalive_count = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.socket_keepalive_idle = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.socket_keepalive_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.socket_timeout = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.tls_allowed_ciphers = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.tls_cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.tls_certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.tls_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.tls_keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cache.username = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] coordination.backend_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.asyncio_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.asyncio_slave_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.backend = sqlalchemy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.connection_debug = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.connection_parameters = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.connection_recycle_time = 3600 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.connection_trace = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.db_inc_retry_interval = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.db_max_retries = 20 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.db_max_retry_interval = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.db_retry_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.max_overflow = 50 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.max_pool_size = 5 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.max_retries = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.mysql_wsrep_sync_wait = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.pool_timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.retry_interval = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.slave_connection = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.sqlite_synchronous = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.synchronous_reader = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] database.use_db_reconnect = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.connection_string = messaging:// {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.es_doc_type = notification {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.es_scroll_size = 10000 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.es_scroll_time = 2m {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.filter_error_trace = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.hmac_keys = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.sentinel_service_name = mymaster {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.socket_timeout = 0.1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.trace_requests = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler.trace_sqlalchemy = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler_jaeger.process_tags = {} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler_jaeger.service_name_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] profiler_otlp.service_name_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.enforce_new_defaults = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: WARNING oslo_config.cfg [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.enforce_scope = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.policy_default_rule = default {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.policy_file = policy.yaml {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_policy.remote_timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.group = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.helper_command = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] privsep_osbrick.user = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.group = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.helper_command = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] cinder_sys_admin.user = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack sudo[82629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 15:44:09 devstack sudo[82629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.send_service_user_token = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] service_user.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.auth_type = password {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] glance.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.chap_username = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.driver_use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.enable_unsupported_driver = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.extra_capabilities = {} {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iscsi_target_flags = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iscsi_write_cache = on {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iser_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iser_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.lvm_mirrors = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.lvm_share_target = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.lvm_type = auto {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.num_shell_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.nvmet_port_id = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.report_discard_supported = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.reserved_percentage = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.scst_target_driver = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.storage_protocol = iSCSI {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_helper = tgtadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_protocol = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.unique_fqdn_network = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.use_chap_auth = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_backend_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_clear = zero {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_clear_size = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volume_group = cinder-volumes {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_reports.file_event_handler = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_reports.log_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.backend_availability_zone = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.backend_host = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.chap_password = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.chap_username = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.chiscsi_conf = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.disk_geometry = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_client_cert = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_data_namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.driver_use_ssl = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.extra_capabilities = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.filter_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.goodness_function = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iser_helper = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iser_ip_address = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iser_port = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.iser_target_prefix = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.lvm_conf_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.lvm_mirrors = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.lvm_share_target = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.lvm_type = auto {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.num_shell_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.nvmet_port_id = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.replication_device = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.report_discard_supported = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.reserved_percentage = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.scst_target_driver = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.storage_protocol = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_helper = lioadm {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_ip_address = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_port = 3260 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_protocol = iscsi {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.trace_flags = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.use_chap_auth = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_clear = zero {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_clear_size = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] lvmdriver-1.volumes_dir = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.ssl_version = {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_notifications.driver = [] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_notifications.retry = -1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] oslo_messaging_notifications.transport_url = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] key_manager.fixed_key = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.barbican_api_version = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.barbican_endpoint = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.barbican_endpoint_type = public {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.barbican_region_name = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.number_of_retries = 60 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.retry_delay = 1 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.send_service_user_token = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.verify_ssl = True {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican.verify_ssl_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.auth_section = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.auth_type = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.cafile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.certfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.collect_timing = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.insecure = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.keyfile = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.split_loggers = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] barbican_service_user.timeout = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.approle_role_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.approle_secret_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.kv_mountpoint = secret {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.kv_path = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.kv_version = 2 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.namespace = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.root_token_id = **** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.ssl_ca_crt_file = None {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.timeout = 60.0 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.use_ssl = False {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:44:09 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] ******************************************************************************** {{(pid=82462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 15:44:09 devstack sudo[82629]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:09 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:09 devstack sudo[82687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:09 devstack sudo[82687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:10 devstack sudo[82687]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:10 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.664s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:10 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 15:44:10 devstack cinder-volume[82623]: INFO cinder.brick.local_dev.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 15:44:10 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:10 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:10 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:10 devstack sudo[82967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:10 devstack sudo[82967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:11 devstack sudo[82967]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:11 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:11 devstack cinder-volume[82623]: DEBUG cinder.brick.local_dev.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82623) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 15:44:11 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:11 devstack sudo[83194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:11 devstack sudo[83194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:12 devstack sudo[83194]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:12 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.271s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:12 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:12 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:12 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:12 devstack sudo[83404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:12 devstack sudo[83404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:13 devstack sudo[83404]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.702s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:13 devstack sudo[83410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 15:44:13 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:13 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.686s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:13 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:13 devstack sudo[83414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:13 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:14 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:14 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:14 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:14 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:14 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:15 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:15 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.869s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:15 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:15 devstack sudo[83429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:15 devstack sudo[83429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:16 devstack sudo[83429]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:16 devstack sudo[83437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:16 devstack sudo[83437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:16 devstack sudo[83437]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:16 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:17 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:17 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:17 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:17 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:17 devstack cinder-volume[82623]: INFO cinder.volume.drivers.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 15:44:17 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:17 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:17 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:17 devstack sudo[83454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:17 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:18 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:18 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.850s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:18 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:44:18 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:18 devstack sudo[83577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:18 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:18 devstack cinder-volume[82462]: DEBUG dbcounter [-] [82462] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:44:19 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:19 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.762s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:19 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:19 devstack sudo[83718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:19 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:19 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:19 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:19 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:20 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:20 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:20 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:20 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:20 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:20 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:20 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:21 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:21 devstack cinder-volume[82623]: INFO cinder.volume.driver [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Driver hasn't implemented _init_vendor_properties() Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG cinder.volume.driver [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82623) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG oslo_db.sqlalchemy.engines [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writer thread running {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG cinder.db.api [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Building query based on filter {{(pid=82623) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG cinder.image.image_utils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82623) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 15:44:21 devstack cinder-volume[82623]: INFO cinder.keymgr.migration [None req-a8a2e5dc-6df2-45e1-ba77-499fb538d880 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:44:21 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:21 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:21 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:22 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:22 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:22 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:22 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:22 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:22 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:22 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:22 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:22 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:22 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:23 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:23 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:23 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:23 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:23 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:24 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG cinder.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Notifying Schedulers of capabilities ... {{(pid=82623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:44:24 devstack cinder-volume[82623]: INFO cinder.volume.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Driver initialization completed successfully. Jun 23 15:44:24 devstack cinder-volume[82623]: INFO cinder.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Initiating service 2 cleanup Jun 23 15:44:24 devstack cinder-volume[82623]: INFO cinder.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Service 2 cleanup completed. Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG cinder.service [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Creating RPC server for service cinder-volume {{(pid=82623) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG cinder.service [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82623) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 15:44:24 devstack cinder-volume[82623]: INFO cinder.volume.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:24 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:44:24 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:24 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:24 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:25 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:25 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:25 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:25 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:25 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:25 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:44:25 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:26 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:26 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:26 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:44:26 devstack sudo[83813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:44:26 devstack sudo[83813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:44:27 devstack sudo[83813]: pam_unix(sudo:session): session closed for user root Jun 23 15:44:27 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:44:27 devstack cinder-volume[82623]: INFO cinder.volume.manager [None req-5980f937-b680-4577-bd39-595b3010b3ac None None] Driver post RPC initialization completed successfully. Jun 23 15:44:37 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:44:37 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:44:37 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager._thread_info {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:44:37 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread count: 6 {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:44:37 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread info: [<_MainThread(MainThread, started 129112624005248)>, , , , , ] {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:45:37 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:45:37 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:45:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:45:37 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:45:37 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:45:37 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Jun 23 15:45:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:45:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:45:37 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:45:37 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:45:38 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Jun 23 15:45:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:45:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:45:38 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:45:38 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:45:39 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:45:39 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:45:39 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:45:39 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG cinder.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Notifying Schedulers of capabilities ... {{(pid=82623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager._thread_info {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread count: 6 {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:45:39 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread info: [<_MainThread(MainThread, started 129112624005248)>, , , , , ] {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:46:37 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:46:37 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:46:37 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:46:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:46:37 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:46:37 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:46:38 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jun 23 15:46:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:46:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:46:38 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:46:38 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:46:39 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:46:39 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:46:39 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:46:39 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG cinder.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Notifying Schedulers of capabilities ... {{(pid=82623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager._thread_info {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread count: 6 {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:46:39 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread info: [<_MainThread(MainThread, started 129112624005248)>, , , , , ] {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:47:37 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:47:37 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:47:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:47:37 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:47:37 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:47:37 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Jun 23 15:47:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:47:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:47:37 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:47:37 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:47:38 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Jun 23 15:47:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:47:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:47:38 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:47:38 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:47:39 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jun 23 15:47:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.711s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:47:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:47:39 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:47:39 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:47:39 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jun 23 15:47:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:47:39 devstack cinder-volume[82623]: DEBUG cinder.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Notifying Schedulers of capabilities ... {{(pid=82623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:47:40 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager._thread_info {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:47:40 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread count: 6 {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:47:40 devstack cinder-volume[82623]: DEBUG cinder.volume.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] thread info: [<_MainThread(MainThread, started 129112624005248)>, , , , , ] {{(pid=82623) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writing DB stats cinder:SELECT=1 {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG dbcounter [-] [82623] Writing DB stats cinder:UPDATE=1 {{(pid=82623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG oslo_service.periodic_task [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82623) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG cinder.volume.drivers.lvm [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Updating volume stats {{(pid=82623) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:48:37 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 15:48:37 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:48:37 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:48:37 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:48:37 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:48:37 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:48:38 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jun 23 15:48:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:48:38 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:48:38 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 15:48:38 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:48:39 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jun 23 15:48:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:48:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:48:39 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 15:48:39 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:48:39 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jun 23 15:48:39 devstack cinder-volume[82623]: DEBUG oslo_concurrency.processutils [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82623) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:48:39 devstack cinder-volume[82623]: DEBUG cinder.manager [None req-ff51d14f-8d6e-4d82-9939-ad666e88d16a None None] Notifying Schedulers of capabilities ... {{(pid=82623) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:49:20 devstack cinder-volume[82462]: INFO oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Caught SIGTERM, stopping children Jun 23 15:49:20 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Acquiring lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:20 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Acquired lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:20 devstack cinder-volume[82462]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Releasing lock "singleton_lock" {{(pid=82462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:20 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Stop services. {{(pid=82462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 15:49:20 devstack cinder-volume[82462]: DEBUG oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Killing children. {{(pid=82462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 15:49:20 devstack cinder-volume[82462]: INFO oslo_service.backend._eventlet.service [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Waiting on 1 children to exit Jun 23 15:49:25 devstack cinder-volume[82623]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 23 15:49:25 devstack cinder-volume[92740]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 15:49:25 devstack cinder-volume[92740]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 15:49:25 devstack cinder-volume[92740]: we strongly recommend against using it for new projects. Jun 23 15:49:25 devstack cinder-volume[92740]: If you are already using Eventlet, we recommend migrating to a different Jun 23 15:49:25 devstack cinder-volume[92740]: framework. For more detail see Jun 23 15:49:25 devstack cinder-volume[92740]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 15:49:25 devstack cinder-volume[92740]: import eventlet # noqa Jun 23 15:49:27 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:27 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:27 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:28 devstack cinder-volume[92740]: INFO dbcounter [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Registered counter for database cinder Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_db.sqlalchemy.engines [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG dbcounter [-] [92740] Writer thread running {{(pid=92740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:49:28 devstack cinder-volume[92740]: INFO cinder.rpc [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 15:49:28 devstack cinder-volume[92740]: INFO cinder.rpc [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_db.sqlalchemy.engines [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:28 devstack cinder-volume[92740]: INFO cinder.volume.manager [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Determined volume DB was empty at startup. Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG cinder.volume.manager [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92740) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 15:49:28 devstack cinder-volume[92740]: INFO cinder.volume.manager [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 15:49:28 devstack cinder-volume[92740]: WARNING stevedore.named [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 15:49:28 devstack cinder-volume[92740]: WARNING castellan.key_manager [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:49:28 devstack cinder-volume[92740]: WARNING cinder.keymgr.conf_key_mgr [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:49:28 devstack cinder-volume[92740]: INFO cinder.volume.manager [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_db.sqlalchemy.engines [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:28 devstack cinder-volume[92740]: INFO oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Starting 1 workers Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Started child 92987 {{(pid=92740) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Full set of CONF: {{(pid=92740) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] ******************************************************************************** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Configuration options gathered from: {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] ================================================================================ {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] allow_availability_zone_fallback = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92987]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] allow_compression_on_image_upload = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] allowed_direct_url_schemes = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] api_rate_limit = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] auth_strategy = keystone {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_availability_zone = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_host = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_stats_polling_interval = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backup_api_class = cinder.backup.api.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backup_name_template = backup-%s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backup_use_same_host = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backup_use_temp_snapshot = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] chap_password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] chap_username = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_internal_tenant_project_id = 14d7c3e985184094a5cb13bd95a424f7 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_internal_tenant_user_id = 38a5af4fd9b5436984e236230a6a338b {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cluster = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] compression_format = gzip {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] compute_api_class = cinder.compute.nova.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] config_dir = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] config_source = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] control_exchange = openstack {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] debug = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] default_availability_zone = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] default_group_type = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] default_volume_type = QuobyteHD {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] disk_geometry = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_client_cert = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_client_cert_key = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_data_namespace = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_ssl_cert_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_ssl_cert_verify = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] driver_use_ssl = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] enable_new_services = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] enable_unsupported_driver = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] enabled_backends = ['QuobyteHD'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] enforce_multipath_for_image_xfer = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] filter_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_api_insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_api_ssl_compression = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_ca_certificates_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:28 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_catalog_info = image:glance:publicURL {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_num_retries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance_request_timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] goodness_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] graceful_shutdown_timeout = 5 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] group_api_class = cinder.group.api.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] host = devstack {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_compress_on_upload = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_conversion_address_space_limit = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_conversion_cpu_limit = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_conversion_disable = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_upload_use_cinder_backend = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_upload_use_internal_tenant = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_volume_cache_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_volume_cache_max_count = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] image_volume_cache_max_size_gb = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] init_host_max_objects_retrieval = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] instance_format = [instance: %(uuid)s] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iscsi_target_flags = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92987]: INFO cinder.volume.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.remotefs [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92987) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iscsi_write_cache = on {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iser_helper = tgtadm {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iser_ip_address = 192.168.122.245 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iser_port = 3260 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_color = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_config_append = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_dir = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_options = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_rotate_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_rotate_interval_type = days {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] log_rotation_type = none {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] max_age = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] max_logfile_count = 30 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] max_logfile_size_mb = 200 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] max_over_subscription_ratio = 20.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] message_reap_interval = 86400 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] message_ttl = 2592000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] migration_create_volume_timeout_secs = 300 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] monkey_patch = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] monkey_patch_modules = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] my_ip = 192.168.122.245 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] no_snapshot_gb_quota = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] num_iser_scan_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] num_shell_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] num_volume_device_scan_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] nvmeof_conn_info_version = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] nvmet_ns_id = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] nvmet_port_id = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_max_limit = 1000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_ext_list = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_listen = 0.0.0.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_listen_port = 8776 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_use_ssl = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] osapi_volume_workers = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] per_volume_size_limit = -1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] periodic_fuzzy_delay = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] periodic_interval = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] project_id_regex = [0-9a-f\-]+ {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] public_endpoint = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] publish_errors = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_backup_gigabytes = 1000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_backups = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_gigabytes = 1000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_groups = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_snapshots = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] quota_volumes = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] rate_limit_burst = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] rate_limit_except_level = CRITICAL {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] rate_limit_interval = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] reinit_driver_count = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] replication_device = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] report_discard_supported = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] report_interval = 120 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] reservation_clean_interval = 86400 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] reservation_expire = 86400 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] reserved_image_namespaces = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] reserved_percentage = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] rpc_response_timeout = 120 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] run_external_periodic_tasks = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] scst_target_driver = iscsi {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] scst_target_iqn_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_down_time = 720 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] shell_completion = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] snapshot_name_template = snapshot-%s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] split_loggers = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] state_path = /opt/stack/data/cinder {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] storage_availability_zone = nova {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] storage_protocol = iSCSI {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] syslog_log_facility = LOG_USER {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_helper = lioadm {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_ip_address = 192.168.122.245 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_port = 3260 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_protocol = iscsi {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] target_secondary_ip_addresses = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] trace_flags = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] transfer_api_class = cinder.transfer.api.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] transport_url = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] until_refresh = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_chap_auth = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_default_quota_class = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_journal = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_json = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_multipath_for_image_xfer = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_stderr = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] use_syslog = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] verify_glance_signatures = enabled {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_api_class = cinder.volume.api.API {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_backend_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_clear = zero {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_clear_ionice = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_clear_size = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_copy_bps_limit = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_dd_blocksize = 1M {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_name_template = volume-%s {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_service_inithost_offload = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volume_usage_audit_period = month {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] zoning_mode = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_concurrency.disable_process_locking = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.auth_section = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.auth_type = password {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.auth_version = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.cache = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.delay_auth_decision = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.http_connect_timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.include_service_catalog = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.interface = public {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_password = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcache_username = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.region_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.service_token_roles_required = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.service_type = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.token_cache_time = 300 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.backend = dogpile.cache.null {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.backend_argument = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.backend_expiration_time = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.config_prefix = cache.oslo {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.debug_cache_backend = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.enable_retry_client = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92987) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 15:49:29 devstack cinder-volume[92987]: WARNING cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 15:49:29 devstack cinder-volume[92987]: WARNING cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.enable_socket_keepalive = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.expiration_time = 600 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Running cmd (subprocess): mount.quobyte {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.hashclient_retry_attempts = 2 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_dead_retry = 300 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_pool_maxsize = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_sasl_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.proxies = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.redis_db = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.redis_sentinel_service_name = mymaster {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.redis_server = localhost:6379 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.retry_attempts = 2 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.retry_delay = 0.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.socket_keepalive_count = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.socket_keepalive_idle = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.socket_keepalive_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.socket_timeout = 1.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.tls_allowed_ciphers = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.tls_cafile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.tls_certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.tls_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.tls_keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cache.username = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] coordination.backend_url = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.asyncio_connection = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.asyncio_slave_connection = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.backend = sqlalchemy {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.connection = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.connection_debug = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.connection_parameters = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.connection_recycle_time = 3600 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.connection_trace = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.db_inc_retry_interval = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.db_max_retries = 20 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.db_max_retry_interval = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.db_retry_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.max_overflow = 50 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.max_pool_size = 5 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.max_retries = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.mysql_wsrep_sync_wait = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.pool_timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.retry_interval = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.slave_connection = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.sqlite_synchronous = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.synchronous_reader = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] database.use_db_reconnect = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.connection_string = messaging:// {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.es_doc_type = notification {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.es_scroll_size = 10000 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.es_scroll_time = 2m {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.filter_error_trace = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.hmac_keys = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.sentinel_service_name = mymaster {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.socket_timeout = 0.1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.trace_requests = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler.trace_sqlalchemy = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler_jaeger.process_tags = {} {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler_jaeger.service_name_prefix = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[82623]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Acquiring lock "singleton_lock" {{(pid=82623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:29 devstack cinder-volume[82623]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Acquired lock "singleton_lock" {{(pid=82623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:29 devstack cinder-volume[82623]: DEBUG oslo_concurrency.lockutils [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Releasing lock "singleton_lock" {{(pid=82623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] profiler_otlp.service_name_prefix = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.enforce_new_defaults = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: WARNING oslo_config.cfg [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.enforce_scope = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.policy_default_rule = default {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.policy_file = policy.yaml {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_policy.remote_timeout = 60.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.group = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.helper_command = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] privsep_osbrick.user = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.group = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.helper_command = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] cinder_sys_admin.user = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.auth_section = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.auth_type = password {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[82623]: WARNING amqp [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.cafile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.collect_timing = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.send_service_user_token = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.split_loggers = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] service_user.timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.auth_section = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.auth_type = password {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.collect_timing = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.region_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.split_loggers = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] glance.timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.backend_availability_zone = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.chap_password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.chap_username = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.disk_geometry = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[82623]: WARNING amqp [None req-8d81c5b9-7eb0-452d-86f7-674fa322c82f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_client_cert = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_client_cert_key = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_data_namespace = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.driver_use_ssl = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.enable_unsupported_driver = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.extra_capabilities = {} {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.filter_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.goodness_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iscsi_target_flags = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iscsi_write_cache = on {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iser_helper = tgtadm {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iser_port = 3260 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack quobyte-client[92992]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 15:49:29 devstack quobyte-client[92992]: Invalid parameters found, error: missing mount point. Jun 23 15:49:29 devstack quobyte-client[92992]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 15:49:29 devstack quobyte-client[92992]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_host = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_login = admin {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_mount_options = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_private_key = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_share_path = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_ssh_port = 22 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.num_shell_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=92987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.nvmet_port_id = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_client_cfg = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: INFO cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc ... Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.quobyte_volume_url = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c -c /etc/quobyte/client-cinder.cfg {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.replication_device = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.report_discard_supported = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.reserved_percentage = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.scst_target_driver = iscsi {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.scst_target_iqn_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.storage_protocol = iSCSI {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_helper = tgtadm {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_port = 3260 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_protocol = iscsi {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.trace_flags = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.unique_fqdn_network = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.use_chap_auth = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_backend_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_clear = zero {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_clear_ionice = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_clear_size = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_reports.file_event_handler = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_reports.log_dir = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.backend_availability_zone = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.backend_host = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.chap_password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.chap_username = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.chiscsi_conf = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.disk_geometry = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c -c /etc/quobyte/client-cinder.cfg Jun 23 15:49:29 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_client_cert = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_client_cert_key = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_data_namespace = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.driver_use_ssl = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.extra_capabilities = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.filter_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.goodness_function = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iscsi_target_flags = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iscsi_write_cache = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iser_helper = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iser_ip_address = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iser_port = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.iser_target_prefix = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_host = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_login = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_mount_options = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_password = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_private_key = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_share_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_ssh_port = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.num_shell_tries = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nvmet_ns_id = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.nvmet_port_id = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.replication_device = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.report_discard_supported = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.reserved_percentage = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.scst_target_driver = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.storage_protocol = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_helper = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_ip_address = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_port = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_prefix = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_protocol = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.trace_flags = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.unique_fqdn_network = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.use_chap_auth = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_clear = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_clear_ionice = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_clear_size = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] QuobyteHD.volumes_dir = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.ssl_version = {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_notifications.driver = [] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_notifications.retry = -1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] oslo_messaging_notifications.transport_url = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] key_manager.fixed_key = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.barbican_api_version = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.barbican_endpoint = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.barbican_endpoint_type = public {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.barbican_region_name = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.cafile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.collect_timing = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.number_of_retries = 60 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.retry_delay = 1 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.send_service_user_token = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.split_loggers = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.verify_ssl = True {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican.verify_ssl_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.auth_section = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.auth_type = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.cafile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.certfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.collect_timing = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.insecure = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.keyfile = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.split_loggers = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] barbican_service_user.timeout = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.approle_role_id = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.approle_secret_id = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.kv_mountpoint = secret {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.kv_path = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.kv_version = 2 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.namespace = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.root_token_id = **** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.ssl_ca_crt_file = None {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.timeout = 60.0 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.use_ssl = False {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:29 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] ******************************************************************************** {{(pid=92740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 15:49:30 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.783s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:30 devstack cinder-volume[92987]: INFO cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc succeeded Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=92987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.798s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:30 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:30 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:30 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.631s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:30 devstack cinder-volume[92987]: INFO cinder.volume.driver [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.volume.driver [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7557106018066, 'free_capacity_gb': 1775.7557106018066, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92987) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_db.sqlalchemy.engines [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92987) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG dbcounter [-] [92987] Writer thread running {{(pid=92987) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.db.api [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Building query based on filter {{(pid=92987) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.image.image_utils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92987) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 15:49:30 devstack cinder-volume[92987]: INFO cinder.keymgr.migration [None req-b0d29eb5-8434-4e03-8780-895714e61f0e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=92987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=92987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:30 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:30 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:30 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:31 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.656s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG cinder.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Notifying Schedulers of capabilities ... {{(pid=92987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:49:31 devstack cinder-volume[92987]: INFO cinder.volume.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Driver initialization completed successfully. Jun 23 15:49:31 devstack cinder-volume[92987]: INFO cinder.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Initiating service 3 cleanup Jun 23 15:49:31 devstack cinder-volume[92987]: INFO cinder.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Service 3 cleanup completed. Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG cinder.service [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Creating RPC server for service cinder-volume {{(pid=92987) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG cinder.service [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92987) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 15:49:31 devstack cinder-volume[92987]: INFO cinder.volume.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=92987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=92987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:31 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:31 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:31 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:32 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:32 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.791s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:32 devstack cinder-volume[92987]: INFO cinder.volume.manager [None req-1e7c76fc-cb91-473e-b692-cade35143787 None None] Driver post RPC initialization completed successfully. Jun 23 15:49:32 devstack cinder-volume[92987]: DEBUG oslo_service.periodic_task [None req-6a7742cd-07f8-419e-918d-910a2d8a9f35 None None] Running periodic task VolumeManager._thread_info {{(pid=92987) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:49:32 devstack cinder-volume[92987]: DEBUG cinder.volume.manager [None req-6a7742cd-07f8-419e-918d-910a2d8a9f35 None None] thread count: 6 {{(pid=92987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:49:32 devstack cinder-volume[92987]: DEBUG cinder.volume.manager [None req-6a7742cd-07f8-419e-918d-910a2d8a9f35 None None] thread info: [<_MainThread(MainThread, started 136193921360000)>, , , , , ] {{(pid=92987) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=92987) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG cinder.volume.drivers.quobyte [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=92987) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92987) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:36 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:36 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:36 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:37 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:37 devstack cinder-volume[92987]: DEBUG oslo_concurrency.processutils [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.679s {{(pid=92987) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:37 devstack cinder-volume[92987]: DEBUG cinder.manager [None req-2273c5cf-0f9c-47c7-b283-c4b45c48fcbc None None] Notifying Schedulers of capabilities ... {{(pid=92987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:49:37 devstack cinder-volume[92740]: INFO oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Caught SIGTERM, stopping children Jun 23 15:49:37 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Acquiring lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:37 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Acquired lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:37 devstack cinder-volume[92740]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Releasing lock "singleton_lock" {{(pid=92740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:37 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Stop services. {{(pid=92740) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 15:49:37 devstack cinder-volume[92740]: DEBUG oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Killing children. {{(pid=92740) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 15:49:37 devstack cinder-volume[92740]: INFO oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Waiting on 1 children to exit Jun 23 15:49:39 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Acquiring lock "singleton_lock" {{(pid=92987) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:39 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Acquired lock "singleton_lock" {{(pid=92987) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:39 devstack cinder-volume[92987]: DEBUG oslo_concurrency.lockutils [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Releasing lock "singleton_lock" {{(pid=92987) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:39 devstack cinder-volume[92987]: WARNING amqp [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 15:49:40 devstack cinder-volume[92987]: WARNING amqp [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 15:49:40 devstack cinder-volume[92740]: INFO oslo_service.backend._eventlet.service [None req-44ff221b-2ea0-4485-95e3-f2a7679ad44b None None] Child 92987 exited with status 0 Jun 23 15:49:40 devstack cinder-volume[93303]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 15:49:40 devstack cinder-volume[93303]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 15:49:40 devstack cinder-volume[93303]: we strongly recommend against using it for new projects. Jun 23 15:49:40 devstack cinder-volume[93303]: If you are already using Eventlet, we recommend migrating to a different Jun 23 15:49:40 devstack cinder-volume[93303]: framework. For more detail see Jun 23 15:49:40 devstack cinder-volume[93303]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 15:49:40 devstack cinder-volume[93303]: import eventlet # noqa Jun 23 15:49:43 devstack cinder-volume[93303]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 15:49:43 devstack cinder-volume[93303]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 15:49:43 devstack cinder-volume[93303]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 15:49:44 devstack cinder-volume[93303]: INFO dbcounter [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Registered counter for database cinder Jun 23 15:49:44 devstack cinder-volume[93303]: DEBUG oslo_db.sqlalchemy.engines [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG dbcounter [-] [93303] Writer thread running {{(pid=93303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:49:45 devstack cinder-volume[93303]: INFO cinder.rpc [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 15:49:45 devstack cinder-volume[93303]: INFO cinder.rpc [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_db.sqlalchemy.engines [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:45 devstack cinder-volume[93303]: INFO cinder.volume.manager [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Determined volume DB was empty at startup. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG cinder.volume.manager [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93303) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 15:49:45 devstack cinder-volume[93303]: WARNING stevedore.named [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 15:49:45 devstack cinder-volume[93303]: WARNING castellan.key_manager [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:49:45 devstack cinder-volume[93303]: WARNING cinder.keymgr.conf_key_mgr [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 15:49:45 devstack cinder-volume[93303]: INFO cinder.volume.manager [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_db.sqlalchemy.engines [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:45 devstack cinder-volume[93303]: INFO oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Starting 1 workers Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Started child 93590 {{(pid=93303) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Full set of CONF: {{(pid=93303) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] ******************************************************************************** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Configuration options gathered from: {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] ================================================================================ {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] allow_availability_zone_fallback = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] allow_compression_on_image_upload = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] allowed_direct_url_schemes = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] api_rate_limit = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] auth_strategy = keystone {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_availability_zone = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_host = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_stats_polling_interval = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backup_api_class = cinder.backup.api.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93590]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backup_name_template = backup-%s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backup_use_same_host = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backup_use_temp_snapshot = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] chap_password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] chap_username = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_internal_tenant_project_id = 14d7c3e985184094a5cb13bd95a424f7 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_internal_tenant_user_id = 38a5af4fd9b5436984e236230a6a338b {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cluster = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] compression_format = gzip {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] compute_api_class = cinder.compute.nova.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] config_dir = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] config_source = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] control_exchange = openstack {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] debug = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] default_availability_zone = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] default_group_type = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] default_volume_type = QuobyteHD {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] disk_geometry = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_client_cert = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_client_cert_key = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_data_namespace = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_ssl_cert_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_ssl_cert_verify = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] driver_use_ssl = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] enable_new_services = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] enable_unsupported_driver = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] enabled_backends = ['QuobyteHD'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] enforce_multipath_for_image_xfer = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] filter_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_api_insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_api_ssl_compression = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_ca_certificates_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_catalog_info = image:glance:publicURL {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_num_retries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance_request_timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] goodness_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] graceful_shutdown_timeout = 5 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] group_api_class = cinder.group.api.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] host = devstack {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_compress_on_upload = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_conversion_address_space_limit = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_conversion_cpu_limit = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_conversion_disable = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_upload_use_cinder_backend = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_upload_use_internal_tenant = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_volume_cache_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_volume_cache_max_count = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] image_volume_cache_max_size_gb = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] init_host_max_objects_retrieval = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] instance_format = [instance: %(uuid)s] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iscsi_target_flags = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iscsi_write_cache = on {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iser_helper = tgtadm {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iser_ip_address = 192.168.122.245 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iser_port = 3260 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_color = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_config_append = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_dir = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_options = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_rotate_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_rotate_interval_type = days {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] log_rotation_type = none {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] max_age = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] max_logfile_count = 30 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] max_logfile_size_mb = 200 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] max_over_subscription_ratio = 20.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] message_reap_interval = 86400 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] message_ttl = 2592000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] migration_create_volume_timeout_secs = 300 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] monkey_patch = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] monkey_patch_modules = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] my_ip = 192.168.122.245 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] no_snapshot_gb_quota = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] num_iser_scan_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] num_shell_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] num_volume_device_scan_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] nvmeof_conn_info_version = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] nvmet_ns_id = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] nvmet_port_id = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_max_limit = 1000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_ext_list = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_listen_port = 8776 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93590) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_use_ssl = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] osapi_volume_workers = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] per_volume_size_limit = -1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] periodic_fuzzy_delay = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] periodic_interval = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] public_endpoint = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] publish_errors = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_backup_gigabytes = 1000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_backups = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_gigabytes = 1000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_groups = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_snapshots = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] quota_volumes = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] rate_limit_burst = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] rate_limit_except_level = CRITICAL {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] rate_limit_interval = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] reinit_driver_count = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] replication_device = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] report_discard_supported = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] report_interval = 120 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] reservation_clean_interval = 86400 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] reservation_expire = 86400 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] reserved_image_namespaces = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] reserved_percentage = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] rpc_response_timeout = 120 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] run_external_periodic_tasks = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] scst_target_driver = iscsi {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] scst_target_iqn_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_down_time = 720 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] shell_completion = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] snapshot_name_template = snapshot-%s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] split_loggers = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] state_path = /opt/stack/data/cinder {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] storage_availability_zone = nova {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] storage_protocol = iSCSI {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] syslog_log_facility = LOG_USER {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_helper = lioadm {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_ip_address = 192.168.122.245 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_port = 3260 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_protocol = iscsi {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] target_secondary_ip_addresses = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] trace_flags = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] transport_url = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] until_refresh = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_chap_auth = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_default_quota_class = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_journal = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_json = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_multipath_for_image_xfer = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_stderr = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] use_syslog = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] verify_glance_signatures = enabled {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_api_class = cinder.volume.api.API {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_backend_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_clear = zero {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_clear_ionice = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_clear_size = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_copy_bps_limit = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_dd_blocksize = 1M {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_name_template = volume-%s {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_service_inithost_offload = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volume_usage_audit_period = month {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] zoning_mode = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_concurrency.disable_process_locking = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.auth_section = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.auth_type = password {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.auth_version = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.cache = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.include_service_catalog = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.interface = public {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_password = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcache_username = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.region_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93590) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.service_type = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.backend = dogpile.cache.null {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.backend_argument = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.backend_expiration_time = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.config_prefix = cache.oslo {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.debug_cache_backend = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.enable_retry_client = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Running cmd (subprocess): mount.quobyte {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.enable_socket_keepalive = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.expiration_time = 600 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.hashclient_retry_attempts = 2 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_dead_retry = 300 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_pool_maxsize = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_sasl_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.proxies = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.redis_db = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.redis_server = localhost:6379 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.retry_attempts = 2 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.retry_delay = 0.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.socket_keepalive_count = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.socket_keepalive_idle = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.socket_keepalive_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.socket_timeout = 1.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.tls_allowed_ciphers = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.tls_cafile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.tls_certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.tls_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.tls_keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cache.username = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] coordination.backend_url = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.asyncio_connection = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.asyncio_slave_connection = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.backend = sqlalchemy {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.connection = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.connection_debug = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.connection_parameters = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.connection_recycle_time = 3600 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.connection_trace = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.db_inc_retry_interval = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.db_max_retries = 20 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.db_max_retry_interval = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.db_retry_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.max_overflow = 50 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.max_pool_size = 5 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.max_retries = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.mysql_wsrep_sync_wait = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.pool_timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.retry_interval = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.slave_connection = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.sqlite_synchronous = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.synchronous_reader = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] database.use_db_reconnect = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.connection_string = messaging:// {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.es_doc_type = notification {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.es_scroll_size = 10000 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.es_scroll_time = 2m {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.filter_error_trace = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.hmac_keys = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.sentinel_service_name = mymaster {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.socket_timeout = 0.1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.trace_requests = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler.trace_sqlalchemy = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler_jaeger.process_tags = {} {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler_jaeger.service_name_prefix = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] profiler_otlp.service_name_prefix = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.enforce_new_defaults = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: WARNING oslo_config.cfg [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.enforce_scope = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.policy_default_rule = default {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.policy_file = policy.yaml {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.group = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.helper_command = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] privsep_osbrick.user = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.group = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.helper_command = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] cinder_sys_admin.user = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.auth_section = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.auth_type = password {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.cafile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.collect_timing = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.send_service_user_token = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.split_loggers = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] service_user.timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.auth_section = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.auth_type = password {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.collect_timing = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.region_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.split_loggers = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] glance.timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.backend_availability_zone = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.chap_password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.chap_username = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.disk_geometry = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_client_cert = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_client_cert_key = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_data_namespace = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.driver_use_ssl = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.extra_capabilities = {} {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.filter_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.goodness_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iscsi_target_flags = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iscsi_write_cache = on {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iser_helper = tgtadm {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iser_port = 3260 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_host = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_login = admin {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_mount_options = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_private_key = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_share_path = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.num_shell_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.quobyte_volume_url = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.replication_device = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.report_discard_supported = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack quobyte-client[93591]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.reserved_percentage = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack quobyte-client[93591]: Invalid parameters found, error: missing mount point. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_helper = tgtadm {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack quobyte-client[93591]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_port = 3260 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_protocol = iscsi {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack quobyte-client[93591]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.trace_flags = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.unique_fqdn_network = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.use_chap_auth = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_backend_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_clear = zero {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_clear_ionice = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_clear_size = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_reports.file_event_handler = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_reports.log_dir = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.backend_availability_zone = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.backend_host = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.chap_password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.chap_username = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.chiscsi_conf = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.disk_geometry = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_client_cert = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_data_namespace = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.driver_use_ssl = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.extra_capabilities = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.filter_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.goodness_function = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iser_helper = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iser_ip_address = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iser_port = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.iser_target_prefix = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_host = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_login = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_mount_options = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_password = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_private_key = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_share_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_ssh_port = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.num_shell_tries = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.nvmet_port_id = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.replication_device = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.report_discard_supported = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.reserved_percentage = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.scst_target_driver = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.storage_protocol = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_helper = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_ip_address = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_port = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_prefix = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_protocol = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.trace_flags = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.use_chap_auth = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_clear = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_clear_size = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] QuobyteHD.volumes_dir = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_notifications.driver = [] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_notifications.retry = -1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] key_manager.fixed_key = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.barbican_api_version = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.barbican_endpoint = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.barbican_endpoint_type = public {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.barbican_region_name = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.cafile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.collect_timing = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.number_of_retries = 60 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.retry_delay = 1 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.send_service_user_token = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.split_loggers = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.verify_ssl = True {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican.verify_ssl_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.auth_section = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.auth_type = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.cafile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.certfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.collect_timing = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.insecure = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.keyfile = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.split_loggers = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] barbican_service_user.timeout = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.approle_role_id = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.approle_secret_id = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.kv_mountpoint = secret {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.kv_path = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.kv_version = 2 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.namespace = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.root_token_id = **** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.ssl_ca_crt_file = None {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.timeout = 60.0 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.use_ssl = False {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 15:49:45 devstack cinder-volume[93303]: DEBUG oslo_service.backend._eventlet.service [None req-4cb19251-d424-4a1e-b7a1-b2e7d7d52553 None None] ******************************************************************************** {{(pid=93303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 15:49:46 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.614s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:46 devstack cinder-volume[93590]: INFO cinder.volume.driver [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG cinder.volume.driver [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754566192627, 'free_capacity_gb': 1775.754566192627, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93590) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_db.sqlalchemy.engines [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93590) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writer thread running {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG cinder.db.api [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Building query based on filter {{(pid=93590) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93590) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:46 devstack cinder-volume[93590]: INFO cinder.keymgr.migration [None req-5e200dd4-6bcd-4ed2-9a5d-6634b4305be3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 15:49:46 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:46 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:47 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.645s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:49:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Driver initialization completed successfully. Jun 23 15:49:47 devstack cinder-volume[93590]: INFO cinder.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Initiating service 3 cleanup Jun 23 15:49:47 devstack cinder-volume[93590]: INFO cinder.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Service 3 cleanup completed. Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG cinder.service [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Creating RPC server for service cinder-volume {{(pid=93590) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG cinder.service [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93590) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 15:49:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:49:47 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:49:47 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:49:47 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jun 23 15:49:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.644s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:49:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-779f6ddb-27f3-48c7-9911-907cf76e6864 None None] Driver post RPC initialization completed successfully. Jun 23 15:49:55 devstack cinder-volume[93303]: DEBUG dbcounter [-] [93303] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:49:57 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:49:57 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:50:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:50:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 6 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:50:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Flow 'volume_create_manager' (ce210ed1-c009-48c6-bc9e-fe4fdd8b8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d445b14-f066-4ba3-8e22-7d49b27a738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d445b14-f066-4ba3-8e22-7d49b27a738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-36751163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e144bab-cc3d-47c6-bff0-b90edbbbefeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2887e50afc42869566aa3166106142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:50:45Z,use_quota=True,user_id='2bc3d923f5374227b86de37a83f43204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43a90e0-7def-4792-80d6-91672ae32f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43a90e0-7def-4792-80d6-91672ae32f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b89cb8d-0810-4915-b65b-c6bef0ec4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b89cb8d-0810-4915-b65b-c6bef0ec4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e144bab-cc3d-47c6-bff0-b90edbbbefeb', 'volume_name': 'volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1225fef-871b-4e7b-9e5a-dcaeabe1230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1225fef-871b-4e7b-9e5a-dcaeabe1230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd90a5e5-6aee-4f1e-b8ee-80a03e98e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:45 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Volume 8e144bab-cc3d-47c6-bff0-b90edbbbefeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb', 'volume_size': 1} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-36751163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e144bab-cc3d-47c6-bff0-b90edbbbefeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2887e50afc42869566aa3166106142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:50:45Z,use_quota=True,user_id='2bc3d923f5374227b86de37a83f43204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Creating volume 8e144bab-cc3d-47c6-bff0-b90edbbbefeb {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:50:45 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:50:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:50:45 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb 1073741824 Jun 23 15:50:45 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:50:46 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jun 23 15:50:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb 1073741824" returned: 0 in 1.138s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:50:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:50:46 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb Jun 23 15:50:46 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:50:47 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" returned: 0 in 0.887s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd90a5e5-6aee-4f1e-b8ee-80a03e98e119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a71eb6d-9c56-4da7-a63a-2f568e5f153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:50:47 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Volume volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb (8e144bab-cc3d-47c6-bff0-b90edbbbefeb): created successfully Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a71eb6d-9c56-4da7-a63a-2f568e5f153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:50:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Flow 'volume_create_manager' (ce210ed1-c009-48c6-bc9e-fe4fdd8b8b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:50:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-80261266-6aea-4cd8-bd68-d1da6a721bac tempest-TaggedAttachmentsTest-904163125 None] Created volume successfully. Jun 23 15:50:57 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:50:57 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:51:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:05 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:51:05 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:07 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.134s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:51:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:51:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 6 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:51:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:51:22 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:51:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Flow 'volume_create_manager' (61700242-c227-4e02-8b66-5bf77ff35893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:51:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3683eb73-8316-4358-a6ed-3a75b05c74c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3683eb73-8316-4358-a6ed-3a75b05c74c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1592856503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b223a2c-1388-48a0-b60b-e0a5665687c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614a2441c1874383b90449d5ac5b9f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:51:23Z,use_quota=True,user_id='fc7b5f090695457a93ec581ad5d09f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b1966-c649-4a58-8ff8-2224b847096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b1966-c649-4a58-8ff8-2224b847096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee685f6-4214-4c17-b319-08ffe5bf6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee685f6-4214-4c17-b319-08ffe5bf6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b223a2c-1388-48a0-b60b-e0a5665687c4', 'volume_name': 'volume-8b223a2c-1388-48a0-b60b-e0a5665687c4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3273ba5-1dab-415c-81c3-0f2b6a696f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3273ba5-1dab-415c-81c3-0f2b6a696f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e377cf7-e986-4d64-9e11-b773134077cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:23 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Volume 8b223a2c-1388-48a0-b60b-e0a5665687c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b223a2c-1388-48a0-b60b-e0a5665687c4', 'volume_size': 1} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1592856503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b223a2c-1388-48a0-b60b-e0a5665687c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614a2441c1874383b90449d5ac5b9f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:51:23Z,use_quota=True,user_id='fc7b5f090695457a93ec581ad5d09f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Creating volume 8b223a2c-1388-48a0-b60b-e0a5665687c4 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:51:23 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:51:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:23 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 1073741824 Jun 23 15:51:23 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:25 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 1073741824" returned: 0 in 2.363s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:25 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 Jun 23 15:51:25 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:27 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4" returned: 0 in 1.650s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] <== create_volume: return (4152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.154s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e377cf7-e986-4d64-9e11-b773134077cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b223a2c-1388-48a0-b60b-e0a5665687c4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b63fb8a-e0ce-4be6-8681-9cc86a68936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:51:27 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Volume volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 (8b223a2c-1388-48a0-b60b-e0a5665687c4): created successfully Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b63fb8a-e0ce-4be6-8681-9cc86a68936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:51:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Flow 'volume_create_manager' (61700242-c227-4e02-8b66-5bf77ff35893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:51:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-efa7d143-062b-4257-9ed9-79ba2437efb1 tempest-VolumesAdminNegativeTest-59667712 None] Created volume successfully. Jun 23 15:51:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Acquiring lock "cinder-8b223a2c-1388-48a0-b60b-e0a5665687c4-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:51:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "cinder-8b223a2c-1388-48a0-b60b-e0a5665687c4-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:51:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Acquiring lock "cinder-quobyte-8b223a2c-1388-48a0-b60b-e0a5665687c4" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:51:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "cinder-quobyte-8b223a2c-1388-48a0-b60b-e0a5665687c4" acquired by "delete_volume" :: waited 0.041s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:51:30 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9eto60jy/privsep.sock'] Jun 23 15:51:30 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9eto60jy/privsep.sock Jun 23 15:51:30 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 15:51:31 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 15:51:32 devstack cinder-volume[93590]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 15:51:33 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:33 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Spawned new privsep daemon via rootwrap Jun 23 15:51:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Accepted privsep connection to /tmp/tmp9eto60jy/privsep.sock {{(pid=93590) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 15:51:33 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 15:51:33 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 15:51:33 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 15:51:33 devstack cinder-volume[93590]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94820 Jun 23 15:51:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae842810-4d8a-4877-90e4-2c62383b5a61]: (2,) {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:51:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d83ed-4231-4246-b423-2756d866519b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:51:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:33 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 Jun 23 15:51:33 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:34 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4" returned: 0 in 1.579s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:34 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4 Jun 23 15:51:34 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:36 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8b223a2c-1388-48a0-b60b-e0a5665687c4" returned: 0 in 1.653s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "cinder-quobyte-8b223a2c-1388-48a0-b60b-e0a5665687c4" released by "delete_volume" :: held 6.361s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:51:36 devstack cinder-volume[93590]: WARNING cinder.quota [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:51:36 devstack cinder-volume[93590]: WARNING cinder.quota [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Created reservations ['2e726a5a-c3b3-46fa-8c13-f6c4366356d6', '574e75e5-58a2-4196-8905-7b795a251544', 'e77a4b4f-a490-4e2f-b604-3613c23bd045', 'ef6ba063-c05d-4d8c-bc5e-23d3759488f7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:51:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:51:36 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:51:36 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:51:38 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jun 23 15:51:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.493s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:51:38 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:51:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Deleted volume successfully. Jun 23 15:51:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d9aaaef3-1024-499c-ab93-a687f7dd97ff tempest-VolumesAdminNegativeTest-59667712 None] Lock "cinder-8b223a2c-1388-48a0-b60b-e0a5665687c4-delete_volume" released by "delete_volume" :: held 8.342s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:51:46 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:51:57 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Flow 'volume_create_manager' (e05f6445-b7be-42e1-b952-4cd51c822025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7820f6c-d90a-4235-b8bb-97fa16258d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7820f6c-d90a-4235-b8bb-97fa16258d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1784557516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba42dc7fada343568493898f4521f2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:52:02Z,use_quota=True,user_id='402bf6d92a984f2b984ffa46618ce917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f0c29d-69ca-4749-a93e-1ce5013c8987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f0c29d-69ca-4749-a93e-1ce5013c8987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25490e09-3404-40ee-bae0-03588904ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25490e09-3404-40ee-bae0-03588904ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'volume_name': 'volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51954f44-10ca-4427-b37f-921b09a71797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51954f44-10ca-4427-b37f-921b09a71797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd15f2-b6f6-4cd8-8dca-fa3d35d530e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Volume bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'volume_size': 1} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1784557516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba42dc7fada343568493898f4521f2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:52:02Z,use_quota=True,user_id='402bf6d92a984f2b984ffa46618ce917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Creating volume bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:52:02 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:52:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:02 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 1073741824 Jun 23 15:52:02 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:04 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 1073741824" returned: 0 in 1.937s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:04 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 Jun 23 15:52:04 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:06 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:52:06 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:06 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" returned: 0 in 1.819s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] <== create_volume: return (3866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.880s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd15f2-b6f6-4cd8-8dca-fa3d35d530e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7335e454-07da-48fa-be81-41d1679a22b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Volume volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 (bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723): created successfully Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7335e454-07da-48fa-be81-41d1679a22b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Flow 'volume_create_manager' (e05f6445-b7be-42e1-b952-4cd51c822025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:52:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4ece468d-8cc9-4335-b7a5-d6e40fc4fbfe tempest-ServerActionsTestOtherA-592040006 None] Created volume successfully. Jun 23 15:52:07 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.311s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:52:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:52:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 8 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:52:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:52:16 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:52:16 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:52:23 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:52:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Flow 'volume_create_manager' (50c0e766-0fa2-4182-98e3-40550eb5f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:52:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973a42ea-944d-4155-ac5d-7a84c18c0a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973a42ea-944d-4155-ac5d-7a84c18c0a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1611040446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda9bef9-73b2-41f6-a002-d7b6f10dafe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a885d81127bf4f2e8aca3b473d40a781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:52:24Z,use_quota=True,user_id='462f202a9cb944f898f805ac2b0b2481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9f3c2f-c498-4d52-ab65-fab34f44c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9f3c2f-c498-4d52-ab65-fab34f44c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8396936-1edb-48e2-9ea9-fcd23f1f3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8396936-1edb-48e2-9ea9-fcd23f1f3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda9bef9-73b2-41f6-a002-d7b6f10dafe7', 'volume_name': 'volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76292d19-d087-42e2-927d-c568329d02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76292d19-d087-42e2-927d-c568329d02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112aaf9c-a157-4993-8332-6972ee8f5131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:24 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Volume fda9bef9-73b2-41f6-a002-d7b6f10dafe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7', 'volume_size': 1} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1611040446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda9bef9-73b2-41f6-a002-d7b6f10dafe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a885d81127bf4f2e8aca3b473d40a781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:52:24Z,use_quota=True,user_id='462f202a9cb944f898f805ac2b0b2481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Creating volume fda9bef9-73b2-41f6-a002-d7b6f10dafe7 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:52:24 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:52:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:24 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 1073741824 Jun 23 15:52:24 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:25 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 1073741824" returned: 0 in 1.724s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:26 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 Jun 23 15:52:26 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:27 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" returned: 0 in 1.398s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] <== create_volume: return (3225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.228s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112aaf9c-a157-4993-8332-6972ee8f5131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d93b8b-4be6-45d0-b3b0-5b7382d5128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:52:27 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Volume volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 (fda9bef9-73b2-41f6-a002-d7b6f10dafe7): created successfully Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d93b8b-4be6-45d0-b3b0-5b7382d5128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:52:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Flow 'volume_create_manager' (50c0e766-0fa2-4182-98e3-40550eb5f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:52:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b7700f16-bd95-4796-a149-7ae762de0b7f tempest-ServerRescueNegativeTestJSON-1150379982 None] Created volume successfully. Jun 23 15:52:34 devstack cinder-volume[93590]: WARNING py.warnings [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 23 15:52:34 devstack cinder-volume[93590]: .first() Jun 23 15:52:34 devstack cinder-volume[93590]: Jun 23 15:52:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:52:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:52:34 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea33dbb-c158-492f-93a6-3b5168c91b4e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:52:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:34 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb Jun 23 15:52:34 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:52:35 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jun 23 15:52:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" returned: 0 in 1.216s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:52:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.248s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:52:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91ce81e0-25a6-4c47-a3d0-1bdb3954238d', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:52:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-038d2127-6504-44a2-b435-367f48d91a45 req-ff81fed1-ba06-4341-a80a-acfb5dd413a4 tempest-TaggedAttachmentsTest-904163125 None] attachment_update completed successfully. Jun 23 15:52:46 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:52:46 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:52:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-bd19ff9c-83c6-46ef-9eb4-a3c53e6f27b4 req-c566e6e3-cdb6-4ed5-8999-3526fb8b6202 tempest-TaggedAttachmentsTest-904163125 None] Terminate volume connection completed successfully. Jun 23 15:52:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-bd19ff9c-83c6-46ef-9eb4-a3c53e6f27b4 req-c566e6e3-cdb6-4ed5-8999-3526fb8b6202 tempest-TaggedAttachmentsTest-904163125 None] Deleting attachment 91ce81e0-25a6-4c47-a3d0-1bdb3954238d. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Acquiring lock "cinder-fda9bef9-73b2-41f6-a002-d7b6f10dafe7-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "cinder-fda9bef9-73b2-41f6-a002-d7b6f10dafe7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Acquiring lock "cinder-quobyte-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "cinder-quobyte-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" acquired by "delete_volume" :: waited 0.047s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e4ecf-70ee-49d5-81e7-7b6e7949e130]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:52:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:52:59 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 Jun 23 15:52:59 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:00 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" returned: 0 in 1.346s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:00 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7 Jun 23 15:53:00 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:01 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" returned: 0 in 1.407s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "cinder-quobyte-fda9bef9-73b2-41f6-a002-d7b6f10dafe7" released by "delete_volume" :: held 2.883s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Flow 'volume_create_manager' (a379f0aa-8b3d-4430-bc1f-8d9f0837d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e9c365-0c99-4499-aaed-5998f56ec373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e9c365-0c99-4499-aaed-5998f56ec373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-235877692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfa7f68-f76b-48c8-ba52-681274fb1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1503285ce5f542eb8c7d29d1641df014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:53:02Z,use_quota=True,user_id='426a4bf840ed41648453b7831e59e0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4198937-c1b1-4983-bbdf-d35cefd1150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4198937-c1b1-4983-bbdf-d35cefd1150e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c0b559-5db8-4e63-b409-b0d571aac39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c0b559-5db8-4e63-b409-b0d571aac39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfa7f68-f76b-48c8-ba52-681274fb1942', 'volume_name': 'volume-9bfa7f68-f76b-48c8-ba52-681274fb1942', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda7dd66-4926-4703-ae77-4e1d36677e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda7dd66-4926-4703-ae77-4e1d36677e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2404af-526e-4c53-8af7-76e93169b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Volume 9bfa7f68-f76b-48c8-ba52-681274fb1942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfa7f68-f76b-48c8-ba52-681274fb1942', 'volume_size': 1} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-235877692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfa7f68-f76b-48c8-ba52-681274fb1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1503285ce5f542eb8c7d29d1641df014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:53:02Z,use_quota=True,user_id='426a4bf840ed41648453b7831e59e0a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Creating volume 9bfa7f68-f76b-48c8-ba52-681274fb1942 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:53:02 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Created reservations ['f657c308-c9d9-4a67-a211-6f8e8267c275', '75e7b90a-ce8f-4b75-9d8b-b57aab9c6a2a', '502496ba-09d8-4903-a0cc-6f640970c7bc', 'facd40d3-b512-45e7-baed-a646f49aab67'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:53:02 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 1073741824 Jun 23 15:53:02 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:02 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:53:02 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:04 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.513s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:53:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Deleted volume successfully. Jun 23 15:53:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-170c8f13-9a0e-43bb-897e-cf4f95d73eef tempest-ServerRescueNegativeTestJSON-1150379982 None] Lock "cinder-fda9bef9-73b2-41f6-a002-d7b6f10dafe7-delete_volume" released by "delete_volume" :: held 5.399s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:04 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 1073741824" returned: 0 in 2.055s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:04 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 Jun 23 15:53:04 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:05 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:53:05 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:06 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942" returned: 0 in 1.908s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] <== create_volume: return (4069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.082s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2404af-526e-4c53-8af7-76e93169b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfa7f68-f76b-48c8-ba52-681274fb1942', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7755f8d-b2e5-4d80-b076-7652afafb652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Volume volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 (9bfa7f68-f76b-48c8-ba52-681274fb1942): created successfully Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7755f8d-b2e5-4d80-b076-7652afafb652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Flow 'volume_create_manager' (a379f0aa-8b3d-4430-bc1f-8d9f0837d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:53:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5323a47e-bb53-4a1f-8c43-849013ad5173 tempest-DeleteServersTestJSON-2143440913 None] Created volume successfully. Jun 23 15:53:08 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 2.302s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53b0fb-aa18-4e8a-9dc2-dc63bf380474]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:08 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 Jun 23 15:53:08 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:09 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" returned: 0 in 0.916s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4375c677-41a3-4dc0-a7af-09660580deff', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:53:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-5c587dae-8c7a-4779-ae6a-e2088727cd53 req-a9ff36e7-0d70-4a73-9abe-d5e12d07fd19 tempest-ServerActionsTestOtherA-592040006 None] attachment_update completed successfully. Jun 23 15:53:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b0c54-eaaf-40fb-88be-5ac1f04252bf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:11 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 Jun 23 15:53:11 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:12 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942" returned: 0 in 1.318s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.338s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-9bfa7f68-f76b-48c8-ba52-681274fb1942', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8529925d-fd9c-4ba4-87cd-f13af2a16e86', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:53:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-10750359-2963-45fe-9fbe-22e71008c0e9 req-1e39ecaf-198b-496b-b5b5-9b9e209332d4 tempest-DeleteServersTestJSON-2143440913 None] attachment_update completed successfully. Jun 23 15:53:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "cinder-8e144bab-cc3d-47c6-bff0-b90edbbbefeb-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "cinder-8e144bab-cc3d-47c6-bff0-b90edbbbefeb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "cinder-quobyte-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "cinder-quobyte-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8851e7c-665f-44b8-92e1-5408d0f8d97f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:15 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb Jun 23 15:53:15 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:16 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" returned: 0 in 1.155s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:16 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb Jun 23 15:53:16 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:16 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" returned: 0 in 0.781s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "cinder-quobyte-8e144bab-cc3d-47c6-bff0-b90edbbbefeb" released by "delete_volume" :: held 1.987s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Created reservations ['fa4cba8d-a362-4957-aec9-8f774513debd', '7a15d226-d3df-4851-94f8-8aecb55ac7cb', '1d07dc8a-3507-45bb-97ea-20d15dded14a', '22e70beb-3961-4c59-8007-5b7db608f68a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:17 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:53:17 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:18 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.304s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:18 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:53:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Deleted volume successfully. Jun 23 15:53:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-40249a1b-c410-4b44-9a1f-853792efd559 tempest-TaggedAttachmentsTest-904163125 None] Lock "cinder-8e144bab-cc3d-47c6-bff0-b90edbbbefeb-delete_volume" released by "delete_volume" :: held 3.608s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-8006e3a3-f13b-4810-aed2-411c30b2dd1c tempest-ServerActionsTestOtherA-592040006 None] Terminate volume connection completed successfully. Jun 23 15:53:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-8006e3a3-f13b-4810-aed2-411c30b2dd1c tempest-ServerActionsTestOtherA-592040006 None] Deleting attachment 4375c677-41a3-4dc0-a7af-09660580deff. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:53:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ed4d6-1575-4c86-acd8-15033eeb9ec4]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:21 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 Jun 23 15:53:21 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:22 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" returned: 0 in 0.907s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.971s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfe0bae0-0f96-47a5-b284-2be6a3fd75c9', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:53:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-2d7af430-2f7e-4af2-84ad-f06ec93a6f94 req-0aaf2854-bf27-4e4a-a5a4-864dfebf893a tempest-ServerActionsTestOtherA-592040006 None] attachment_update completed successfully. Jun 23 15:53:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-5ae70455-e538-4434-9fbd-f1a0e2de9617 req-df1d5cdd-6573-4b8d-a95f-5c40f6b107b8 tempest-DeleteServersTestJSON-2143440913 None] Terminate volume connection completed successfully. Jun 23 15:53:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-5ae70455-e538-4434-9fbd-f1a0e2de9617 req-df1d5cdd-6573-4b8d-a95f-5c40f6b107b8 tempest-DeleteServersTestJSON-2143440913 None] Deleting attachment 8529925d-fd9c-4ba4-87cd-f13af2a16e86. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "cinder-9bfa7f68-f76b-48c8-ba52-681274fb1942-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "cinder-9bfa7f68-f76b-48c8-ba52-681274fb1942-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "cinder-quobyte-9bfa7f68-f76b-48c8-ba52-681274fb1942" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "cinder-quobyte-9bfa7f68-f76b-48c8-ba52-681274fb1942" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1115624-3c2e-43ef-abdf-4ec8362d8414]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:26 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 Jun 23 15:53:26 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:27 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942" returned: 0 in 0.967s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:27 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942 Jun 23 15:53:27 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:27 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bfa7f68-f76b-48c8-ba52-681274fb1942" returned: 0 in 0.818s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "cinder-quobyte-9bfa7f68-f76b-48c8-ba52-681274fb1942" released by "delete_volume" :: held 1.842s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Created reservations ['5efe65f3-6d7c-4f75-a33e-ca43e088ed99', 'bb6beae7-bf9e-4e8a-b6b4-caa3dbd3c816', '8af1c678-be62-46c8-aadd-a7fadf56861c', '2209d7e0-b05b-4104-bf1a-cef6ac33cdb7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:28 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:53:28 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:29 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.114s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:29 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:53:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Deleted volume successfully. Jun 23 15:53:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52a71670-a384-4deb-b6de-656a6c1f5a59 tempest-DeleteServersTestJSON-2143440913 None] Lock "cinder-9bfa7f68-f76b-48c8-ba52-681274fb1942-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=39,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:53:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=34,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Flow 'volume_create_manager' (11c4f661-6921-4f91-b68e-d0f3ce3d72c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65227ff-215a-49ca-8d57-64d0ba989789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65227ff-215a-49ca-8d57-64d0ba989789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2113551158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4142846e-3445-400a-b3dc-4f9e6cafa194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e9bcb644bd4ed4bba51e692bde3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:53:41Z,use_quota=True,user_id='fd278ea377de47ab974b89e4dcc06115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81f22c5-0ac2-406f-a16a-d75e586959ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81f22c5-0ac2-406f-a16a-d75e586959ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0831b-659d-44c6-a3aa-4a71f7d469d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0831b-659d-44c6-a3aa-4a71f7d469d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4142846e-3445-400a-b3dc-4f9e6cafa194', 'volume_name': 'volume-4142846e-3445-400a-b3dc-4f9e6cafa194', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e80c42-2945-4a9a-b16e-214847568209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e80c42-2945-4a9a-b16e-214847568209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6148115-5555-44db-9077-23252724dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Volume 4142846e-3445-400a-b3dc-4f9e6cafa194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4142846e-3445-400a-b3dc-4f9e6cafa194', 'volume_size': 1} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2113551158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4142846e-3445-400a-b3dc-4f9e6cafa194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e9bcb644bd4ed4bba51e692bde3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:53:41Z,use_quota=True,user_id='fd278ea377de47ab974b89e4dcc06115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Creating volume 4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:53:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:53:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:41 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 1073741824 Jun 23 15:53:41 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:42 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 1073741824" returned: 0 in 1.257s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:42 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 Jun 23 15:53:42 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:43 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194" returned: 0 in 0.911s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6148115-5555-44db-9077-23252724dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4142846e-3445-400a-b3dc-4f9e6cafa194', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae0fbd9-b774-4853-96b7-4f04e17b41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:53:43 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Volume volume-4142846e-3445-400a-b3dc-4f9e6cafa194 (4142846e-3445-400a-b3dc-4f9e6cafa194): created successfully Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae0fbd9-b774-4853-96b7-4f04e17b41a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:53:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Flow 'volume_create_manager' (11c4f661-6921-4f91-b68e-d0f3ce3d72c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:53:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-289f6e74-76df-4e57-b763-35f739e64cd2 req-cecafabf-59f0-45be-9a4f-99627314b4ec tempest-VolumesSnapshotsTestJSON-1877574273 None] Created volume successfully. Jun 23 15:53:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Creating offline snapshot 534e429c-5a69-4b28-87de-9d94609eabde of volume 4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:53:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06989f9c-499f-4a85-bfe4-6b3fab0ffd1f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:45 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 Jun 23 15:53:45 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:46 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194" returned: 0 in 0.975s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:46 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde 1G Jun 23 15:53:46 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:47 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde 1G" returned: 0 in 1.052s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142846e-3445-400a-b3dc-4f9e6cafa194 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:47 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142846e-3445-400a-b3dc-4f9e6cafa194 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde Jun 23 15:53:47 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:47 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142846e-3445-400a-b3dc-4f9e6cafa194 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde" returned: 0 in 0.786s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:47 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde is being set with open permissions: ugo+rw Jun 23 15:53:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:47 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde Jun 23 15:53:47 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:48 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde" returned: 0 in 0.713s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:48 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info Jun 23 15:53:48 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:49 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info" returned: 0 in 0.786s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:49 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info is being set with open permissions: ugo+rw Jun 23 15:53:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:49 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info Jun 23 15:53:49 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:50 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.info" returned: 0 in 0.956s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.407s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-ef9d5c7d-ef87-4ab9-a46a-b50974a9665c req-9c8acb64-76fd-4d24-92eb-af2a21f41929 tempest-VolumesSnapshotsTestJSON-1877574273 None] Create snapshot completed successfully Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "cinder-534e429c-5a69-4b28-87de-9d94609eabde-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-534e429c-5a69-4b28-87de-9d94609eabde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "cinder-quobyte-534e429c-5a69-4b28-87de-9d94609eabde" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-534e429c-5a69-4b28-87de-9d94609eabde" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Deleting offline snapshot 534e429c-5a69-4b28-87de-9d94609eabde of volume 4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:53:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] snapshot_file for this snap is: volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:53:51 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eafa52-f6ff-47f0-85c6-8fb605b4c7d9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:51 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde Jun 23 15:53:51 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:52 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde" returned: 0 in 1.111s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4142846e-3445-400a-b3dc-4f9e6cafa194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:53:52 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d103e-cda7-447f-a997-888267e82a7f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:52 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 Jun 23 15:53:52 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:53 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194" returned: 0 in 1.052s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:53 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde Jun 23 15:53:53 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:54 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde" returned: 0 in 1.039s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:54 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde Jun 23 15:53:54 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:55 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194.534e429c-5a69-4b28-87de-9d94609eabde" returned: 0 in 0.687s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-534e429c-5a69-4b28-87de-9d94609eabde" released by "_delete_snapshot" :: held 4.097s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" released by "delete_snapshot" :: held 4.126s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:55 devstack cinder-volume[93590]: WARNING cinder.quota [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.quota [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Created reservations ['21c55ba1-6cc1-4fc8-8df7-97fe77f04271', 'a6a2521a-1805-4b7b-9752-0df723b59089', 'ebfe24b7-b11f-4403-b189-94b7ad690c74', '59a271f1-d339-4c5c-9505-3e022c234fec'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:53:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Delete snapshot completed successfully. Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-a238ca50-7d95-4b50-b95d-3f61ca74b3de req-5e4f0f33-825d-4edc-a869-ecfed556ea51 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-534e429c-5a69-4b28-87de-9d94609eabde-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "cinder-4142846e-3445-400a-b3dc-4f9e6cafa194-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-4142846e-3445-400a-b3dc-4f9e6cafa194-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee21328-e5ea-4ece-8e15-04e5f416311b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:53:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:55 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 Jun 23 15:53:55 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:56 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194" returned: 0 in 0.843s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:56 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194 Jun 23 15:53:56 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:57 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4142846e-3445-400a-b3dc-4f9e6cafa194" returned: 0 in 0.633s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-quobyte-4142846e-3445-400a-b3dc-4f9e6cafa194" released by "delete_volume" :: held 1.555s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.quota [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Created reservations ['5ff4e1a1-b231-45c7-b227-a188c405cebc', 'ffe63586-0233-459c-ad00-5b0c284b1d7a', '4662f2ad-1171-4f76-9f8c-809c3339022b', '0c7b41ba-d202-45ee-857b-4def478f9690'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:53:57 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:53:57 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:53:57 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.733s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.manager [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:53:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Deleted volume successfully. Jun 23 15:53:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-4a8dd9e4-1609-423d-9100-ffcdb6843c32 req-ca911708-ac3e-490a-ad85-158b015811d5 tempest-VolumesSnapshotsTestJSON-1877574273 None] Lock "cinder-4142846e-3445-400a-b3dc-4f9e6cafa194-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:53:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-da029680-42d0-40c2-aff1-221a05dbe691 req-77c0ab0b-6775-4ac9-a9fe-d2e2449d97fe tempest-ServerActionsTestOtherA-592040006 None] Terminate volume connection completed successfully. Jun 23 15:53:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-da029680-42d0-40c2-aff1-221a05dbe691 req-77c0ab0b-6775-4ac9-a9fe-d2e2449d97fe tempest-ServerActionsTestOtherA-592040006 None] Deleting attachment dfe0bae0-0f96-47a5-b284-2be6a3fd75c9. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (89d80c2e-9281-410a-9d65-44141da81080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42684a1b-1009-4c80-b5cd-23e491b2b38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42684a1b-1009-4c80-b5cd-23e491b2b38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807100252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43172bac-0cfa-4c14-bf65-ad018c579a84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:02Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1149fa82-31a3-4af5-bcc6-713fa918bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1149fa82-31a3-4af5-bcc6-713fa918bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4909c4-f879-43e1-92ce-aafe8c1dcf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4909c4-f879-43e1-92ce-aafe8c1dcf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43172bac-0cfa-4c14-bf65-ad018c579a84', 'volume_name': 'volume-43172bac-0cfa-4c14-bf65-ad018c579a84', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00271a2d-5438-4c0d-ae97-05dd9c75da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00271a2d-5438-4c0d-ae97-05dd9c75da5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2762649-1c39-47b4-bdbb-97e39b149415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Volume 43172bac-0cfa-4c14-bf65-ad018c579a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43172bac-0cfa-4c14-bf65-ad018c579a84', 'volume_size': 1} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807100252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43172bac-0cfa-4c14-bf65-ad018c579a84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:02Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Creating volume 43172bac-0cfa-4c14-bf65-ad018c579a84 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:54:02 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:54:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:02 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 1073741824 Jun 23 15:54:02 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:03 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 1073741824" returned: 0 in 1.555s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:03 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 Jun 23 15:54:03 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:04 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84" returned: 0 in 0.779s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2762649-1c39-47b4-bdbb-97e39b149415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43172bac-0cfa-4c14-bf65-ad018c579a84', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884ffa9-ed27-4615-bcea-158de71e0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Volume volume-43172bac-0cfa-4c14-bf65-ad018c579a84 (43172bac-0cfa-4c14-bf65-ad018c579a84): created successfully Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884ffa9-ed27-4615-bcea-158de71e0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (89d80c2e-9281-410a-9d65-44141da81080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c02db50e-de35-49b3-bcd6-65d19826b3f5 tempest-VolumesTestJSON-122471678 None] Created volume successfully. Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:05 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:54:05 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (17c5277f-129c-451d-af8b-7e5e10da6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8085c4f-b6ed-41e4-b2a1-40548b68bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8085c4f-b6ed-41e4-b2a1-40548b68bf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1644330764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d024f1-12da-4193-ba5e-56ed2be75b0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:06Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df2f547-ab11-46cb-b0fa-17dd7ab1cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df2f547-ab11-46cb-b0fa-17dd7ab1cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7360a6bc-4f3a-4743-99ee-5e67dfeb5334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7360a6bc-4f3a-4743-99ee-5e67dfeb5334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d024f1-12da-4193-ba5e-56ed2be75b0f', 'volume_name': 'volume-64d024f1-12da-4193-ba5e-56ed2be75b0f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bba7710-188d-4459-a4b3-a73f273e51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bba7710-188d-4459-a4b3-a73f273e51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e516e0e5-942a-4711-9421-d8aac7498c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Volume 64d024f1-12da-4193-ba5e-56ed2be75b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d024f1-12da-4193-ba5e-56ed2be75b0f', 'volume_size': 1} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1644330764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d024f1-12da-4193-ba5e-56ed2be75b0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:06Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Creating volume 64d024f1-12da-4193-ba5e-56ed2be75b0f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:54:06 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:06 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f 1073741824 Jun 23 15:54:06 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:06 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.792s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 8 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:54:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:54:07 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f 1073741824" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:07 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f Jun 23 15:54:07 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:08 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f" returned: 0 in 0.738s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e516e0e5-942a-4711-9421-d8aac7498c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d024f1-12da-4193-ba5e-56ed2be75b0f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234be15b-87bb-4ff6-901a-914032365e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Volume volume-64d024f1-12da-4193-ba5e-56ed2be75b0f (64d024f1-12da-4193-ba5e-56ed2be75b0f): created successfully Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234be15b-87bb-4ff6-901a-914032365e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (17c5277f-129c-451d-af8b-7e5e10da6d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bad96ff4-50dd-4d47-9bdc-aa31c9ba65c8 tempest-VolumesTestJSON-122471678 None] Created volume successfully. Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (87901479-00f2-44d4-ba66-78ce77d5d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b117b830-c428-4c93-88ab-53a57680679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b117b830-c428-4c93-88ab-53a57680679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-521796858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc70d00c-9027-4e92-878d-742045b7bac7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:09Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dff24-2cdd-4c20-98da-65e0ddb59100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dff24-2cdd-4c20-98da-65e0ddb59100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f94c7-8e48-41c4-abcd-db0060318420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789f94c7-8e48-41c4-abcd-db0060318420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc70d00c-9027-4e92-878d-742045b7bac7', 'volume_name': 'volume-bc70d00c-9027-4e92-878d-742045b7bac7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4a89fa-c38a-4065-a4c1-518425b5315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4a89fa-c38a-4065-a4c1-518425b5315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3900701c-8b50-4d05-a58e-14241d6e40f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Volume bc70d00c-9027-4e92-878d-742045b7bac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc70d00c-9027-4e92-878d-742045b7bac7', 'volume_size': 1} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-521796858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc70d00c-9027-4e92-878d-742045b7bac7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a1bc361837de458b9d94892e50a484f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:09Z,use_quota=True,user_id='42ef746f5a8f421c98c74e5b33af872f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Creating volume bc70d00c-9027-4e92-878d-742045b7bac7 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:54:09 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:54:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:09 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 1073741824 Jun 23 15:54:09 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:10 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 1073741824" returned: 0 in 0.965s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:10 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 Jun 23 15:54:10 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "cinder-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "cinder-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "cinder-quobyte-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "cinder-quobyte-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544726d-b925-48d7-b545-49015d13f328]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:11 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3900701c-8b50-4d05-a58e-14241d6e40f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc70d00c-9027-4e92-878d-742045b7bac7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa650d-5c39-43fa-a993-2650de982215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:11 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 Jun 23 15:54:11 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Volume volume-bc70d00c-9027-4e92-878d-742045b7bac7 (bc70d00c-9027-4e92-878d-742045b7bac7): created successfully Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fa650d-5c39-43fa-a993-2650de982215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Flow 'volume_create_manager' (87901479-00f2-44d4-ba66-78ce77d5d900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-499d1e4f-a802-44a2-b9e3-cfd5fd70566b tempest-VolumesTestJSON-122471678 None] Created volume successfully. Jun 23 15:54:12 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" returned: 0 in 1.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:12 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723 Jun 23 15:54:12 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:14 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" returned: 0 in 1.611s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "cinder-quobyte-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723" released by "delete_volume" :: held 3.530s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Created reservations ['989e3f25-c704-4303-8f57-bfaa90a312d1', '8a0c96d1-ec38-466d-a870-37cd596bb03d', 'fe9372c7-dfb0-4b9a-8920-7645a6848fcc', '55326cb5-68e4-4824-8d7c-456db8994fea'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:14 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:54:14 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-bc70d00c-9027-4e92-878d-742045b7bac7-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "cinder-bc70d00c-9027-4e92-878d-742045b7bac7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-quobyte-bc70d00c-9027-4e92-878d-742045b7bac7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-bc70d00c-9027-4e92-878d-742045b7bac7" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c88ca-0a91-4a8c-95df-965feb12058c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:15 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 Jun 23 15:54:15 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:16 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.284s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:16 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:54:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Deleted volume successfully. Jun 23 15:54:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b68be295-b88c-470a-bd5d-871c857ce076 tempest-ServerActionsTestOtherA-592040006 None] Lock "cinder-bbf0e2ba-e0d4-49f2-b7df-9b1ada0be723-delete_volume" released by "delete_volume" :: held 5.237s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:17 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7" returned: 0 in 1.886s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:17 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7 Jun 23 15:54:17 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:18 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bc70d00c-9027-4e92-878d-742045b7bac7" returned: 0 in 0.985s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-bc70d00c-9027-4e92-878d-742045b7bac7" released by "delete_volume" :: held 2.969s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Created reservations ['c44118af-6e1c-48ea-8017-a5e010ac0492', '7e3d648c-c28c-4069-a414-9f711e2edb96', 'da3a0f32-af6a-4128-9657-154a941275a9', 'ba8d9bbe-1e6e-4ea6-8059-2664af3c9b64'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:18 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:54:18 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-64d024f1-12da-4193-ba5e-56ed2be75b0f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "cinder-64d024f1-12da-4193-ba5e-56ed2be75b0f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-quobyte-64d024f1-12da-4193-ba5e-56ed2be75b0f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-64d024f1-12da-4193-ba5e-56ed2be75b0f" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[34321c71-8635-4b61-a6ac-0ccf5612d28a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:19 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f Jun 23 15:54:19 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:21 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 2.372s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:21 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:54:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Deleted volume successfully. Jun 23 15:54:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-caae4695-bc8f-459c-9619-fe0e7b120989 tempest-VolumesTestJSON-122471678 None] Lock "cinder-bc70d00c-9027-4e92-878d-742045b7bac7-delete_volume" released by "delete_volume" :: held 5.876s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:21 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f" returned: 0 in 2.072s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:21 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f Jun 23 15:54:21 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:22 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-64d024f1-12da-4193-ba5e-56ed2be75b0f" returned: 0 in 1.168s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-64d024f1-12da-4193-ba5e-56ed2be75b0f" released by "delete_volume" :: held 3.326s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Created reservations ['56f07b20-a9dc-4037-9383-27544a7ba664', 'a3956c0c-1faf-49e1-8067-65cae1860e3a', '933e92ac-9f36-477b-a985-f0de65c974c0', 'b8c424ba-b854-4791-b14c-98a46ab53a34'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:22 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:54:22 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-43172bac-0cfa-4c14-bf65-ad018c579a84-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "cinder-43172bac-0cfa-4c14-bf65-ad018c579a84-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Acquiring lock "cinder-quobyte-43172bac-0cfa-4c14-bf65-ad018c579a84" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-43172bac-0cfa-4c14-bf65-ad018c579a84" acquired by "delete_volume" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab80e6f-ff3a-4c98-9848-50cf050c9663]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:23 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 Jun 23 15:54:23 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:23 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.050s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:23 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:54:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Deleted volume successfully. Jun 23 15:54:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-469d3ca1-1ca4-4ebd-ac33-a2847f120ba6 tempest-VolumesTestJSON-122471678 None] Lock "cinder-64d024f1-12da-4193-ba5e-56ed2be75b0f-delete_volume" released by "delete_volume" :: held 4.725s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:24 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84" returned: 0 in 1.252s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:24 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84 Jun 23 15:54:24 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:25 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-43172bac-0cfa-4c14-bf65-ad018c579a84" returned: 0 in 1.121s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "cinder-quobyte-43172bac-0cfa-4c14-bf65-ad018c579a84" released by "delete_volume" :: held 2.485s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Created reservations ['61230a3d-9776-45fe-ba57-cf7122ad7b22', '49f38128-2297-4bdd-901b-e5fe75da2999', 'fff3cbc0-f5aa-447f-99bc-1ee777083f10', 'de192abd-097a-48d5-959a-130a4b8fa200'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:25 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:54:25 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:26 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.299s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:26 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:54:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Deleted volume successfully. Jun 23 15:54:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8c2c846e-e41f-4665-983e-3da31ab51497 tempest-VolumesTestJSON-122471678 None] Lock "cinder-43172bac-0cfa-4c14-bf65-ad018c579a84-delete_volume" released by "delete_volume" :: held 4.207s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:54:35 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=41,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=6 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:54:36 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=46,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=4 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:54:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e4b58d67-acd5-4391-a899-9a10de24f518 tempest-GroupsV314Test-1312276915 None] Group tempest-GroupsV314Test-Group-1767737549: creating Jun 23 15:54:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e4b58d67-acd5-4391-a899-9a10de24f518 tempest-GroupsV314Test-1312276915 None] Group tempest-GroupsV314Test-Group-1767737549: created successfully Jun 23 15:54:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e4b58d67-acd5-4391-a899-9a10de24f518 tempest-GroupsV314Test-1312276915 None] Create group completed successfully. Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Flow 'volume_create_manager' (a74fa9e5-c3c9-49d5-a2ca-7740e921a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa65581-ee4b-48a1-97e0-a7800601d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa65581-ee4b-48a1-97e0-a7800601d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110001840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=608a6bf5-008d-428a-aa78-adcb62562aa0,host='devstack@QuobyteHD#QuobyteHD',id=16fa0b75-efbf-467a-84cd-71f80a446cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4608cb6a534711ae468c458cb03013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:42Z,use_quota=True,user_id='bf772d3165194ded8ca9836f3ab690cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dbca6b3-dac3-4f33-a033-0fbac5478080),volume_type_id=3dbca6b3-dac3-4f33-a033-0fbac5478080)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee56962-6b44-455e-baff-2af49dbcb35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee56962-6b44-455e-baff-2af49dbcb35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b622c3d-25c0-4887-858a-991f50500c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b622c3d-25c0-4887-858a-991f50500c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fa0b75-efbf-467a-84cd-71f80a446cdb', 'volume_name': 'volume-16fa0b75-efbf-467a-84cd-71f80a446cdb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57f7222-636b-4d45-842f-48f038a429db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57f7222-636b-4d45-842f-48f038a429db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f4d27e-5f43-4bff-bc03-78ba56bfc0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Volume 16fa0b75-efbf-467a-84cd-71f80a446cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fa0b75-efbf-467a-84cd-71f80a446cdb', 'volume_size': 1} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=608a6bf5-008d-428a-aa78-adcb62562aa0,created_at=2026-06-23T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110001840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=608a6bf5-008d-428a-aa78-adcb62562aa0,host='devstack@QuobyteHD#QuobyteHD',id=16fa0b75-efbf-467a-84cd-71f80a446cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4608cb6a534711ae468c458cb03013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:42Z,use_quota=True,user_id='bf772d3165194ded8ca9836f3ab690cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dbca6b3-dac3-4f33-a033-0fbac5478080),volume_type_id=3dbca6b3-dac3-4f33-a033-0fbac5478080)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Creating volume 16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:54:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:54:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:41 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb 1073741824 Jun 23 15:54:41 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Flow 'volume_create_manager' (1d094928-bd94-4e57-a044-7bb679c7f9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13d2dc4-ceaa-4292-8c03-f72a1fa521e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13d2dc4-ceaa-4292-8c03-f72a1fa521e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1411444411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3fcf8d-b93f-4de3-ab18-3577ccce4607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e652ec6f8f284828aa56c1467772e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:42Z,use_quota=True,user_id='c5db52798a87401c89a77ae2101fd058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2e59c-27da-43d2-b612-65d70c3169da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2e59c-27da-43d2-b612-65d70c3169da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03c853d-40bc-4635-8d53-057c4af7d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03c853d-40bc-4635-8d53-057c4af7d04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3fcf8d-b93f-4de3-ab18-3577ccce4607', 'volume_name': 'volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2206245a-5a02-4c56-bbeb-1082632bf29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2206245a-5a02-4c56-bbeb-1082632bf29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f40080-4395-4b44-a869-0b72f58f7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Volume 3e3fcf8d-b93f-4de3-ab18-3577ccce4607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607', 'volume_size': 1} Jun 23 15:54:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:43 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb 1073741824" returned: 0 in 1.403s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:43 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:54:43 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:44 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.768s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1411444411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3fcf8d-b93f-4de3-ab18-3577ccce4607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e652ec6f8f284828aa56c1467772e920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:42Z,use_quota=True,user_id='c5db52798a87401c89a77ae2101fd058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Creating volume 3e3fcf8d-b93f-4de3-ab18-3577ccce4607 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:54:44 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f4d27e-5f43-4bff-bc03-78ba56bfc0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fa0b75-efbf-467a-84cd-71f80a446cdb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:44 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 1073741824 Jun 23 15:54:44 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a5b4b-dc63-4bad-9ca7-1a203492eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:44 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Volume volume-16fa0b75-efbf-467a-84cd-71f80a446cdb (16fa0b75-efbf-467a-84cd-71f80a446cdb): created successfully Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a5b4b-dc63-4bad-9ca7-1a203492eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Flow 'volume_create_manager' (a74fa9e5-c3c9-49d5-a2ca-7740e921a407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-88941be9-aebe-46e3-9709-5723a2517b27 tempest-GroupsV314Test-1312276915 None] Created volume successfully. Jun 23 15:54:45 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 1073741824" returned: 0 in 0.948s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:45 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 Jun 23 15:54:45 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:45 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" returned: 0 in 0.637s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f40080-4395-4b44-a869-0b72f58f7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ddaa5-213e-4f0b-85c3-24154735984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:45 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Volume volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 (3e3fcf8d-b93f-4de3-ab18-3577ccce4607): created successfully Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ddaa5-213e-4f0b-85c3-24154735984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Flow 'volume_create_manager' (1d094928-bd94-4e57-a044-7bb679c7f9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2693df58-acb6-4369-8417-cb1b54ba7ba6 tempest-AttachVolumeShelveTestJSON-278109412 None] Created volume successfully. Jun 23 15:54:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:46 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Cloning volume 16fa0b75-efbf-467a-84cd-71f80a446cdb to volume 25261c8a-f426-4466-b4eb-10b8d4b8b6d2 Jun 23 15:54:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Creating offline snapshot 4d44deb8-06d7-4e2c-b45c-a421ca7e54ae of volume 16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:54:46 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8440dd-a819-4363-85c5-ce4d1d819647]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:47 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:54:47 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Flow 'volume_create_manager' (06fb1ee0-b95d-4346-a7cd-819891c4eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11cbeb-aa0f-4350-a61c-7ad83245abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11cbeb-aa0f-4350-a61c-7ad83245abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-751625545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0105ffea-bd34-44b9-9d05-97616a1ee163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff228e14a3e41aa8e09d8ff2c409590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:47Z,use_quota=True,user_id='a05b0f20007c4cafb141c1e50b43b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dc7811-1a48-4d7f-b365-98a2b1e3d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dc7811-1a48-4d7f-b365-98a2b1e3d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa8e0b4-f81e-4be0-bee2-ad679dc75488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa8e0b4-f81e-4be0-bee2-ad679dc75488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0105ffea-bd34-44b9-9d05-97616a1ee163', 'volume_name': 'volume-0105ffea-bd34-44b9-9d05-97616a1ee163', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334b7ee1-e8ae-4d62-871b-e37febefec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334b7ee1-e8ae-4d62-871b-e37febefec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c5560-6ba1-4603-a080-1ce616fc33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:47 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Volume 0105ffea-bd34-44b9-9d05-97616a1ee163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0105ffea-bd34-44b9-9d05-97616a1ee163', 'volume_size': 1} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:47 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.943s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:47 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae 1G Jun 23 15:54:47 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Flow 'volume_create_manager' (27f70b0e-3665-4c48-9cc1-0c6500309569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a919dc38-859e-470a-9a5e-234022c48fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a919dc38-859e-470a-9a5e-234022c48fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-362619367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf66c54-415b-4f6e-97a5-25a5daa8d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f34122c08b4fd19c870c49e0177a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:49Z,use_quota=True,user_id='2a72a99c86ce4ead95e513c42767169b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9041494-e9db-41a3-a8c3-25b1caa3a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9041494-e9db-41a3-a8c3-25b1caa3a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f11d14-5930-4039-8440-c488c2331c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f11d14-5930-4039-8440-c488c2331c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf66c54-415b-4f6e-97a5-25a5daa8d380', 'volume_name': 'volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb118d4-3e14-4298-9cd0-ba0f247cea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb118d4-3e14-4298-9cd0-ba0f247cea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd67b5b-bff4-4eb1-ac67-dd4069fa810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:54:48 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Volume 8cf66c54-415b-4f6e-97a5-25a5daa8d380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380', 'volume_size': 1} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae 1G" returned: 0 in 0.947s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fa0b75-efbf-467a-84cd-71f80a446cdb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:48 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fa0b75-efbf-467a-84cd-71f80a446cdb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:54:48 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:49 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16fa0b75-efbf-467a-84cd-71f80a446cdb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.685s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:49 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae is being set with open permissions: ugo+rw: NotImplementedError Jun 23 15:54:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:49 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:54:49 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:50 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.840s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:50 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info Jun 23 15:54:50 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:50 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info" returned: 0 in 0.690s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:51 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:51 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info Jun 23 15:54:51 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:51 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.info" returned: 0 in 0.628s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Acquiring lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] snapshot: 4d44deb8-06d7-4e2c-b45c-a421ca7e54ae, volume: 25261c8a-f426-4466-b4eb-10b8d4b8b6d2, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2310a6-2837-4a04-9a46-2cb0f17a6b2f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:51 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:54:51 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:52 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.836s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16fa0b75-efbf-467a-84cd-71f80a446cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6969784-606d-4911-8755-8310c0124734]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:52 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:54:52 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:53 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.741s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:53 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 15:54:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:53 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 Jun 23 15:54:53 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:54:59 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jun 23 15:54:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" returned: 0 in 5.816s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:54:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4dac5c-2bd3-444b-94f0-5e8df830f59d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:54:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:54:59 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:54:59 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:00 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.920s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:55:00 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Converted 1024.00 MB image at 176.05 MB/s Jun 23 15:55:00 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:00 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 Jun 23 15:55:00 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=10,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:55:00 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" returned: 0 in 0.673s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" released by "_copy_volume_from_snapshot" :: held 9.066s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Acquiring lock "cinder-quobyte-4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Deleting offline snapshot 4d44deb8-06d7-4e2c-b45c-a421ca7e54ae of volume 16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] snapshot_file for this snap is: volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a103a126-6472-49f2-8c91-e9cd17851a0b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:00 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:55:00 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:01 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.872s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16fa0b75-efbf-467a-84cd-71f80a446cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:55:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653d738-6e28-4724-930f-b174cfcd68ef]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:01 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:55:01 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:02 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 1.030s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:02 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:55:02 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:03 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.831s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:03 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae Jun 23 15:55:03 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:04 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb.4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" returned: 0 in 0.662s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-4d44deb8-06d7-4e2c-b45c-a421ca7e54ae" released by "_delete_snapshot" :: held 3.492s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.528s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.944s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-751625545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0105ffea-bd34-44b9-9d05-97616a1ee163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff228e14a3e41aa8e09d8ff2c409590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:47Z,use_quota=True,user_id='a05b0f20007c4cafb141c1e50b43b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Creating volume 0105ffea-bd34-44b9-9d05-97616a1ee163 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:04 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:04 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 1073741824 Jun 23 15:55:04 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fa9f4d9c-b309-4e9a-89e6-ca2dac30e0b4 tempest-GroupsV314Test-1312276915 None] Create group from source-group-608a6bf5-008d-428a-aa78-adcb62562aa0 completed successfully. Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-7df5880a-bdf7-4e4f-9642-71c1bb135752 req-b82f9b45-355f-471e-bb00-57339aa4d7ec tempest-AttachVolumeShelveTestJSON-278109412 None] No connector for attachment 1c80d2af-4ed9-457c-b7b1-16c22b93d623; skipping storage backend terminate_connection call. {{(pid=93590) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 15:55:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-7df5880a-bdf7-4e4f-9642-71c1bb135752 req-b82f9b45-355f-471e-bb00-57339aa4d7ec tempest-AttachVolumeShelveTestJSON-278109412 None] Deleting attachment 1c80d2af-4ed9-457c-b7b1-16c22b93d623. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:55:05 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 1073741824" returned: 0 in 0.984s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:05 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 Jun 23 15:55:05 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Acquiring lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b6e17-c051-48fd-93fe-e0c519d1c4de]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:05 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 Jun 23 15:55:05 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:05 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:05 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:06 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163" returned: 0 in 1.028s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.622s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-362619367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf66c54-415b-4f6e-97a5-25a5daa8d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f34122c08b4fd19c870c49e0177a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:54:49Z,use_quota=True,user_id='2a72a99c86ce4ead95e513c42767169b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Creating volume 8cf66c54-415b-4f6e-97a5-25a5daa8d380 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:06 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:06 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 1073741824 Jun 23 15:55:06 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c5560-6ba1-4603-a080-1ce616fc33df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0105ffea-bd34-44b9-9d05-97616a1ee163', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e55ef4-a0ee-4ec0-9e6e-5ea4cb95e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Volume volume-0105ffea-bd34-44b9-9d05-97616a1ee163 (0105ffea-bd34-44b9-9d05-97616a1ee163): created successfully Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e55ef4-a0ee-4ec0-9e6e-5ea4cb95e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Flow 'volume_create_manager' (06fb1ee0-b95d-4346-a7cd-819891c4eea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bad5e2e2-8f3c-48c7-b70d-6de8d7bc107f tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Created volume successfully. Jun 23 15:55:06 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:06 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" returned: 0 in 1.127s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.823s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 8 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:55:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:55:06 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2 Jun 23 15:55:06 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:07 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 1073741824" returned: 0 in 1.152s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:07 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" returned: 0 in 0.865s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-25261c8a-f426-4466-b4eb-10b8d4b8b6d2" released by "delete_volume" :: held 2.078s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:07 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 Jun 23 15:55:07 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Created reservations ['49ac5f5c-716e-44c3-bce0-a442c91bd988'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:07 devstack cinder-volume[93590]: WARNING cinder.quota [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-905125891 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-905125891, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:07 devstack cinder-volume[93590]: WARNING cinder.quota [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-905125891 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-905125891, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Created reservations ['a5324878-6651-49d5-b574-c1459cae040b', '80721b29-6f32-4d05-8f71-0f69e0ab78ca', '0d21c44f-8bcc-4b7c-bcb3-1add66c80716', 'd611739e-18d0-4503-a3bc-bce91d0d9f1d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:07 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:07 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Acquiring lock "cinder-0105ffea-bd34-44b9-9d05-97616a1ee163-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "cinder-0105ffea-bd34-44b9-9d05-97616a1ee163-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Acquiring lock "cinder-quobyte-0105ffea-bd34-44b9-9d05-97616a1ee163" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "cinder-quobyte-0105ffea-bd34-44b9-9d05-97616a1ee163" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489af94-8666-4e90-ba7b-8222b334ed9a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:08 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380" returned: 0 in 0.695s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd67b5b-bff4-4eb1-ac67-dd4069fa810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24eb896b-5f0f-42e9-98a6-9d337bef2388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Volume volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 (8cf66c54-415b-4f6e-97a5-25a5daa8d380): created successfully Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24eb896b-5f0f-42e9-98a6-9d337bef2388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Flow 'volume_create_manager' (27f70b0e-3665-4c48-9cc1-0c6500309569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:08 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 Jun 23 15:55:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-65c4af0f-e988-4261-8b36-8155c080fe9c tempest-ServersNegativeTestJSON-55488518 None] Created volume successfully. Jun 23 15:55:08 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Acquiring lock "cinder-quobyte-16fa0b75-efbf-467a-84cd-71f80a446cdb" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-16fa0b75-efbf-467a-84cd-71f80a446cdb" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49e9d6-89a8-43d5-9d50-82166e6e0174]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:08 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:55:08 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:08 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.826s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:08 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3edc0438-8d77-412d-862f-be8200b44174 tempest-GroupsV314Test-1312276915 None] Delete group completed successfully. Jun 23 15:55:09 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163" returned: 0 in 0.926s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:09 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163 Jun 23 15:55:09 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:09 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.862s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:09 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb Jun 23 15:55:09 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:09 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0105ffea-bd34-44b9-9d05-97616a1ee163" returned: 0 in 0.728s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "cinder-quobyte-0105ffea-bd34-44b9-9d05-97616a1ee163" released by "delete_volume" :: held 1.722s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Created reservations ['8a66733a-121d-4381-9824-41026536975f', 'e013112e-fd16-4178-96fb-589b21cf5a4f', 'd881135e-e822-4508-8f21-dd9e1e0769d6', '3485a2fb-f00d-48e4-b7de-8c155fa56336'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:10 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-16fa0b75-efbf-467a-84cd-71f80a446cdb" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:10 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:10 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Lock "cinder-quobyte-16fa0b75-efbf-467a-84cd-71f80a446cdb" released by "delete_volume" :: held 1.740s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Created reservations ['8ab73b2a-58ac-4bbe-a4a1-35d58b36f37c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Created reservations ['2fe2c9f8-6118-4e73-847e-7845a1bd8faf', '43190749-320d-4286-b0f5-461393310a7c', '0968d987-376c-4c64-bf3f-0135f02ca756', '32139290-d20b-4946-9718-2ac9dd363391'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:10 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:10 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:10 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.761s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Deleted volume successfully. Jun 23 15:55:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f28fb97b-5563-4317-bf97-a57f0f5cfd69 tempest-VolumeQuotasNegativeTestJSON-1985759520 None] Lock "cinder-0105ffea-bd34-44b9-9d05-97616a1ee163-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Flow 'volume_create_manager' (a05fab7b-57c8-42f6-bb86-958862b82ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df23ebfe-271e-451d-918b-be46dd83bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df23ebfe-271e-451d-918b-be46dd83bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-896416037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c07acfa-e3bd-48ba-af97-534437a25b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f34122c08b4fd19c870c49e0177a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:11Z,use_quota=True,user_id='2a72a99c86ce4ead95e513c42767169b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2ecfcc-bc1c-446e-b8f4-0425ba4a083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2ecfcc-bc1c-446e-b8f4-0425ba4a083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed4252c-474e-4d48-a2a5-bee78d1beb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed4252c-474e-4d48-a2a5-bee78d1beb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c07acfa-e3bd-48ba-af97-534437a25b77', 'volume_name': 'volume-1c07acfa-e3bd-48ba-af97-534437a25b77', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ed4831-ad5a-443d-8187-fcdfb38b3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ed4831-ad5a-443d-8187-fcdfb38b3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b137d1-e7f0-48f0-b1f8-73bcd2ed13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Volume 1c07acfa-e3bd-48ba-af97-534437a25b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c07acfa-e3bd-48ba-af97-534437a25b77', 'volume_size': 1} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-896416037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c07acfa-e3bd-48ba-af97-534437a25b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f34122c08b4fd19c870c49e0177a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:11Z,use_quota=True,user_id='2a72a99c86ce4ead95e513c42767169b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Creating volume 1c07acfa-e3bd-48ba-af97-534437a25b77 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:11 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:11 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.811s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:11 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8676807f-9fc1-48e7-9258-a940ddab06b0 tempest-GroupsV314Test-1312276915 None] Delete group completed successfully. Jun 23 15:55:11 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 1073741824 Jun 23 15:55:11 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:12 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 1073741824" returned: 0 in 0.966s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:12 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 Jun 23 15:55:12 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:13 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77" returned: 0 in 0.746s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b137d1-e7f0-48f0-b1f8-73bcd2ed13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c07acfa-e3bd-48ba-af97-534437a25b77', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f1808a-161f-494b-9ed8-ba84f96468ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Volume volume-1c07acfa-e3bd-48ba-af97-534437a25b77 (1c07acfa-e3bd-48ba-af97-534437a25b77): created successfully Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f1808a-161f-494b-9ed8-ba84f96468ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Flow 'volume_create_manager' (a05fab7b-57c8-42f6-bb86-958862b82ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-91cb6bf3-f2b8-4df0-aaa7-4b325531370c tempest-ServersNegativeTestJSON-55488518 None] Created volume successfully. Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "cinder-1c07acfa-e3bd-48ba-af97-534437a25b77-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-1c07acfa-e3bd-48ba-af97-534437a25b77-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "cinder-quobyte-1c07acfa-e3bd-48ba-af97-534437a25b77" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-quobyte-1c07acfa-e3bd-48ba-af97-534437a25b77" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134f2fb-4ad0-43db-a8b6-d785932a0365]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:15 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 Jun 23 15:55:15 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:16 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77" returned: 0 in 0.897s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:16 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77 Jun 23 15:55:16 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:17 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1c07acfa-e3bd-48ba-af97-534437a25b77" returned: 0 in 1.009s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-quobyte-1c07acfa-e3bd-48ba-af97-534437a25b77" released by "delete_volume" :: held 1.980s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Created reservations ['3b1d3257-06bc-4ae6-bac1-72eeda4bb28d', '1cabedf5-24a6-47c5-a439-78b5d28372f6', '916a58ca-b52b-4632-a951-315ece6971f0', '426feaa7-0af5-4ea8-ae6d-e1f1574b8a65'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:17 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:17 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "cinder-8cf66c54-415b-4f6e-97a5-25a5daa8d380-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-8cf66c54-415b-4f6e-97a5-25a5daa8d380-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "cinder-quobyte-8cf66c54-415b-4f6e-97a5-25a5daa8d380" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-quobyte-8cf66c54-415b-4f6e-97a5-25a5daa8d380" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ccb4a5-4764-472b-a5bd-fac2bf7986b0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:17 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 Jun 23 15:55:17 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:18 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.134s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:18 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Deleted volume successfully. Jun 23 15:55:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7c5cd661-1304-4818-8128-c23808d25b40 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-1c07acfa-e3bd-48ba-af97-534437a25b77-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:19 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380" returned: 0 in 1.336s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:19 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380 Jun 23 15:55:19 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-24223c27-b2bc-4611-9d5b-7b1f0edf217d tempest-GroupsV320Test-444685609 None] Group tempest-GroupsV320Test-Group-1988615812: creating Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Flow 'volume_create_manager' (60b9d93d-e78f-4e11-82be-daabfeee96fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c60e4b-a4c8-49e0-8075-c29fe4fa31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-24223c27-b2bc-4611-9d5b-7b1f0edf217d tempest-GroupsV320Test-444685609 None] Group tempest-GroupsV320Test-Group-1988615812: created successfully Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c60e4b-a4c8-49e0-8075-c29fe4fa31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1469417831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f846c7-4430-4673-8643-8131855f216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da3a8e9ee3b4cb58394abccc2d1d8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:19Z,use_quota=True,user_id='7543833d03664bd284cac95033801407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20a9013b-8f75-41bc-82c0-3d7f2505ee08),volume_type_id=20a9013b-8f75-41bc-82c0-3d7f2505ee08)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df61d37-1d8d-4b86-96b4-9cbf2eb2a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df61d37-1d8d-4b86-96b4-9cbf2eb2a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1ae9bd-3aa7-4075-8e9c-1bba78e02a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1ae9bd-3aa7-4075-8e9c-1bba78e02a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f846c7-4430-4673-8643-8131855f216a', 'volume_name': 'volume-e6f846c7-4430-4673-8643-8131855f216a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979e0319-e91d-4a2c-9b90-04a8d9217e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979e0319-e91d-4a2c-9b90-04a8d9217e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fa976f-9cc9-4e0c-aa5e-20929e972db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:19 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Volume e6f846c7-4430-4673-8643-8131855f216a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f846c7-4430-4673-8643-8131855f216a', 'volume_size': 1} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1469417831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f846c7-4430-4673-8643-8131855f216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da3a8e9ee3b4cb58394abccc2d1d8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:19Z,use_quota=True,user_id='7543833d03664bd284cac95033801407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20a9013b-8f75-41bc-82c0-3d7f2505ee08),volume_type_id=20a9013b-8f75-41bc-82c0-3d7f2505ee08)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Creating volume e6f846c7-4430-4673-8643-8131855f216a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:19 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-24223c27-b2bc-4611-9d5b-7b1f0edf217d tempest-GroupsV320Test-444685609 None] Create group completed successfully. Jun 23 15:55:19 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a 1073741824 Jun 23 15:55:19 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:19 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8cf66c54-415b-4f6e-97a5-25a5daa8d380" returned: 0 in 0.835s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-quobyte-8cf66c54-415b-4f6e-97a5-25a5daa8d380" released by "delete_volume" :: held 2.254s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Created reservations ['e44c32eb-ad23-40f4-acdf-9e870acedd28', '6337c1d5-22dc-4038-b087-d8ee47a234fc', '3c6ff2c4-cc64-4864-9de2-d99001aa5146', '0ec0af9d-fb21-4efd-8c43-06b6f07c1877'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:20 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:20 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:20 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a 1073741824" returned: 0 in 0.928s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:20 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a Jun 23 15:55:20 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:20 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.705s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Deleted volume successfully. Jun 23 15:55:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-52d93d95-5211-4955-83ca-c53f38d12db3 tempest-ServersNegativeTestJSON-55488518 None] Lock "cinder-8cf66c54-415b-4f6e-97a5-25a5daa8d380-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Created reservations ['426bdf88-f100-44eb-97d6-e2a0fc3849d3'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:21 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:21 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:21 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a" returned: 0 in 0.985s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fa976f-9cc9-4e0c-aa5e-20929e972db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f846c7-4430-4673-8643-8131855f216a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5cbcf4-00d8-4351-9950-7ea3aa611862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Volume volume-e6f846c7-4430-4673-8643-8131855f216a (e6f846c7-4430-4673-8643-8131855f216a): created successfully Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5cbcf4-00d8-4351-9950-7ea3aa611862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Flow 'volume_create_manager' (60b9d93d-e78f-4e11-82be-daabfeee96fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5e58e86d-e4a0-4fdd-9d16-e21925e6b944 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Created volume successfully. Jun 23 15:55:21 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.839s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:21 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1de6c2f2-4cc8-4e4f-a791-e8c01e461767 tempest-GroupsV320Test-444685609 None] Delete group completed successfully. Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:23 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:23 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.772s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:24 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:24 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3f7e6233-b150-4dea-a1f6-7816f2088db1 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Retype volume completed successfully. Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "cinder-e6f846c7-4430-4673-8643-8131855f216a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "cinder-e6f846c7-4430-4673-8643-8131855f216a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "cinder-quobyte-e6f846c7-4430-4673-8643-8131855f216a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "cinder-quobyte-e6f846c7-4430-4673-8643-8131855f216a" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e7409-3fde-40c4-86be-5b6bf7c03744]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:24 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a Jun 23 15:55:24 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:25 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a" returned: 0 in 0.928s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:25 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a Jun 23 15:55:25 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:26 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6f846c7-4430-4673-8643-8131855f216a" returned: 0 in 1.083s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "cinder-quobyte-e6f846c7-4430-4673-8643-8131855f216a" released by "delete_volume" :: held 2.082s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:26 devstack cinder-volume[93590]: WARNING cinder.quota [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:26 devstack cinder-volume[93590]: WARNING cinder.quota [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Created reservations ['67252776-dbb1-43e8-8f0a-309f5758762b', '71421f3d-53ce-49c4-ac5e-b8bfdf3d0480', 'd4926bb2-3ede-4ecd-b9fb-e8d06d3ef616', '25b7450a-6fa5-44ff-a461-18505af728f6'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:27 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:27 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:28 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.161s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:28 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Deleted volume successfully. Jun 23 15:55:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2a6638c3-6df7-4735-929f-862d75cacdb9 tempest-VolumeRetypeWithoutMigrationTest-290726356 None] Lock "cinder-e6f846c7-4430-4673-8643-8131855f216a-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:37 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=75,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=3 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:55:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=76,cinder:SELECT=60,cinder:INSERT=16,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Flow 'volume_create_manager' (7142de5d-24eb-47db-91c6-76c6d54fc214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8662ef-cf86-455f-8f95-eb0a31f20dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8662ef-cf86-455f-8f95-eb0a31f20dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-897815774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54502369-6613-4960-8aad-607d61ae05da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0d7991624005a10936c1d1bbef7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:40Z,use_quota=True,user_id='150e6ad57628428c9abf3b0bfabf323a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1da3987-af70-4a5b-b2e8-712b17df7944),volume_type_id=d1da3987-af70-4a5b-b2e8-712b17df7944)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1d04c-1332-4c5b-92d7-eac81b203015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1d04c-1332-4c5b-92d7-eac81b203015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88943f49-70f3-4f2c-9e11-67092c174837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88943f49-70f3-4f2c-9e11-67092c174837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54502369-6613-4960-8aad-607d61ae05da', 'volume_name': 'volume-54502369-6613-4960-8aad-607d61ae05da', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca3700-89d0-4f2e-90f1-4a18ec56873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca3700-89d0-4f2e-90f1-4a18ec56873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad095406-727e-4b8a-ae90-bfc45c8c4028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Volume 54502369-6613-4960-8aad-607d61ae05da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54502369-6613-4960-8aad-607d61ae05da', 'volume_size': 1} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-897815774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54502369-6613-4960-8aad-607d61ae05da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0d7991624005a10936c1d1bbef7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:40Z,use_quota=True,user_id='150e6ad57628428c9abf3b0bfabf323a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1da3987-af70-4a5b-b2e8-712b17df7944),volume_type_id=d1da3987-af70-4a5b-b2e8-712b17df7944)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Creating volume 54502369-6613-4960-8aad-607d61ae05da {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:40 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:40 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da 1073741824 Jun 23 15:55:40 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:41 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da 1073741824" returned: 0 in 1.246s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:42 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da Jun 23 15:55:42 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Flow 'volume_create_manager' (97d9c573-c6f5-4b0c-a425-74d726b9685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de95808-5f85-4998-b190-d02572e179fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de95808-5f85-4998-b190-d02572e179fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1580694763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68c49c-8778-44d3-9c4c-0c3aa1a8627a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b3b9a0f8c0467ca3899615fb32c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:42Z,use_quota=True,user_id='adebc73455534518b74096d9895d3599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385c29db-d032-4402-bfc3-3b83285d7764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385c29db-d032-4402-bfc3-3b83285d7764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2b4e14-2ab7-41e6-8126-c5a72fb73213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2b4e14-2ab7-41e6-8126-c5a72fb73213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c68c49c-8778-44d3-9c4c-0c3aa1a8627a', 'volume_name': 'volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac27feba-6e6d-4f83-a7e9-4bb399adb170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac27feba-6e6d-4f83-a7e9-4bb399adb170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d158c1a-0406-4ba1-bf7c-795df7adc283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a', 'volume_size': 1} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:42 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da" returned: 0 in 0.721s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1580694763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c68c49c-8778-44d3-9c4c-0c3aa1a8627a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b3b9a0f8c0467ca3899615fb32c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:55:42Z,use_quota=True,user_id='adebc73455534518b74096d9895d3599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Creating volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:55:42 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:42 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a 1073741824 Jun 23 15:55:42 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad095406-727e-4b8a-ae90-bfc45c8c4028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54502369-6613-4960-8aad-607d61ae05da', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9324df8-8dd6-43ee-ace2-922ae18acdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Volume volume-54502369-6613-4960-8aad-607d61ae05da (54502369-6613-4960-8aad-607d61ae05da): created successfully Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9324df8-8dd6-43ee-ace2-922ae18acdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Flow 'volume_create_manager' (7142de5d-24eb-47db-91c6-76c6d54fc214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-23d825a0-30b6-4614-9dcf-b3beb3136e07 tempest-VolumeTypesAccessTest-1131990077 None] Created volume successfully. Jun 23 15:55:43 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a 1073741824" returned: 0 in 1.018s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Acquiring lock "cinder-54502369-6613-4960-8aad-607d61ae05da-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "cinder-54502369-6613-4960-8aad-607d61ae05da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Acquiring lock "cinder-quobyte-54502369-6613-4960-8aad-607d61ae05da" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:43 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a Jun 23 15:55:43 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "cinder-quobyte-54502369-6613-4960-8aad-607d61ae05da" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3f11d-80a1-4226-b6f5-76ba1a8a2d52]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:44 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da Jun 23 15:55:44 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:44 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" returned: 0 in 0.745s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d158c1a-0406-4ba1-bf7c-795df7adc283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b7601-3a06-4cb0-9984-8a0715cb5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:55:44 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Volume volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a (8c68c49c-8778-44d3-9c4c-0c3aa1a8627a): created successfully Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026b7601-3a06-4cb0-9984-8a0715cb5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Flow 'volume_create_manager' (97d9c573-c6f5-4b0c-a425-74d726b9685f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:55:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-12bb675a-d77d-4e8f-9831-6a07f7f2e583 tempest-SnapshotsActionsTest-881655375 None] Created volume successfully. Jun 23 15:55:44 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da" returned: 0 in 1.019s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:44 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da Jun 23 15:55:44 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:45 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-54502369-6613-4960-8aad-607d61ae05da" returned: 0 in 0.704s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "cinder-quobyte-54502369-6613-4960-8aad-607d61ae05da" released by "delete_volume" :: held 1.790s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:45 devstack cinder-volume[93590]: WARNING cinder.quota [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1773255431 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1773255431, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:45 devstack cinder-volume[93590]: WARNING cinder.quota [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1773255431 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1773255431, it is now deprecated. Please use the default quota class for default quota. Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Created reservations ['e306e369-c354-4b47-a588-b36b9e0407dd', '2ab19d1b-7703-4266-b13a-d852c2611e66', '0a22336a-eece-4394-806c-c96926d148a5', '84bbb9a0-1de5-42cd-a815-b165d3c4dd37'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:45 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:55:45 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Creating offline snapshot c65042bd-a44a-4320-a79a-abdee1fa15a4 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[38848838-9131-4df5-aeb9-aa9dcb9dfa82]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:46 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a Jun 23 15:55:46 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:46 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.033s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:46 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:55:46 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Deleted volume successfully. Jun 23 15:55:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-198405b3-eb69-4b15-8384-b537d48022d1 tempest-VolumeTypesAccessTest-1131990077 None] Lock "cinder-54502369-6613-4960-8aad-607d61ae05da-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:55:47 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" returned: 0 in 1.312s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:47 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 1G Jun 23 15:55:47 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:48 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 1G" returned: 0 in 1.539s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:48 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:55:48 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:49 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.049s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:49 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 is being set with open permissions: ugo+rw Jun 23 15:55:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:49 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:55:49 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:50 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:50 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info Jun 23 15:55:50 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:51 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info" returned: 0 in 0.958s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:51 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info is being set with open permissions: ugo+rw Jun 23 15:55:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:51 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info Jun 23 15:55:51 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:52 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.info" returned: 0 in 1.161s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.021s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-842db88c-6ccc-4a50-90b1-a9e8f394aae3 tempest-SnapshotsActionsTest-881655375 None] Create snapshot completed successfully Jun 23 15:55:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:55:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:55:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Creating offline snapshot f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:55:54 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cace0a-d6de-4195-87f7-77996b3e4d9d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:54 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:55:54 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:55 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.063s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:55:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:55 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 1G Jun 23 15:55:55 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:56 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 1G" returned: 0 in 1.082s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:56 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 Jun 23 15:55:56 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:57 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" returned: 0 in 0.844s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:57 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 is being set with open permissions: ugo+rw Jun 23 15:55:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:57 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 Jun 23 15:55:57 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:58 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" returned: 0 in 0.740s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.857s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:55:58 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2a6f37c5-23c9-4bc5-b1d9-d17291e1cdcd tempest-SnapshotsActionsTest-881655375 None] Create snapshot completed successfully Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Deleting offline snapshot f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] snapshot_file for this snap is: volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14931d5-2e62-41a7-b8fc-b0eed022e027]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:58 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 Jun 23 15:55:58 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:55:59 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jun 23 15:55:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" returned: 0 in 1.007s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:55:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:55:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c914f-78e7-467d-a756-0fb5fe7efddb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:55:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:55:59 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:55:59 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Acquiring lock "cinder-3e3fcf8d-b93f-4de3-ab18-3577ccce4607-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "cinder-3e3fcf8d-b93f-4de3-ab18-3577ccce4607-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:00 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.108s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:00 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 Jun 23 15:56:00 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Acquiring lock "cinder-quobyte-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "cinder-quobyte-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281c8ee-05e0-47c1-b0b5-cd5e5191ceaa]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:01 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 Jun 23 15:56:01 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:02 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" returned: 0 in 1.183s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:02 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2 Jun 23 15:56:02 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:02 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" returned: 0 in 1.362s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:02 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607 Jun 23 15:56:02 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:03 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" returned: 0 in 1.138s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2" released by "_delete_snapshot" :: held 4.569s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_snapshot" :: held 4.609s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Created reservations ['691bc278-eda7-41ae-abb6-e18784afaadf', '1d5c88d0-008c-4964-8156-8b4449b24b3c', '79aa0a90-ceae-45b2-998f-f0bc210b6b61', '70842808-e408-4e19-b76e-fe97b9c431bd'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:03 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" returned: 0 in 1.095s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "cinder-quobyte-3e3fcf8d-b93f-4de3-ab18-3577ccce4607" released by "delete_volume" :: held 2.514s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Delete snapshot completed successfully. Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d01cfe86-9c6c-4d2f-974c-6d6c47fd3594 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-f0e3cde4-674f-40f4-a457-33d5fd3a7eb2-delete_snapshot" released by "delete_snapshot" :: held 4.901s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Created reservations ['4c020652-e7c1-43c3-8895-8b23482c0595', '9dcc7494-2ea3-4965-8c04-ed53d2c9c452', '7967e1fe-768e-419d-a470-1c66f6288447', '647dcfe9-b549-4050-8d88-4fc7624e661c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:03 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:56:03 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Creating offline snapshot f5d0b4a2-e98c-4f96-a291-4590fd2e513f of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1f8594-f681-42cf-b4f6-bc48ab9a39ce]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:04 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:04 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:04 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.217s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:56:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Deleted volume successfully. Jun 23 15:56:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d05b840-c56a-4f1f-8013-953ff2db6dc0 tempest-AttachVolumeShelveTestJSON-278109412 None] Lock "cinder-3e3fcf8d-b93f-4de3-ab18-3577ccce4607-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:05 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.118s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:05 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f 1G Jun 23 15:56:05 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:05 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:56:05 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:06 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.934s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:56:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:56:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 8 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:56:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:56:07 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f 1G" returned: 0 in 1.260s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:07 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f Jun 23 15:56:07 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:07 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f" returned: 0 in 0.964s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:07 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f is being set with open permissions: ugo+rw Jun 23 15:56:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:08 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f Jun 23 15:56:08 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:08 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f" returned: 0 in 0.902s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.393s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3590190b-2598-466b-b5a8-db3187c98dbd tempest-SnapshotsActionsTest-881655375 None] Create snapshot completed successfully Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Flow 'volume_create_manager' (907b6557-c3a9-4ce1-be75-fcc66168f710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18444665-ce66-4b9b-94e4-c1346514214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18444665-ce66-4b9b-94e4-c1346514214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-320660099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2395de18-262f-4a26-8125-af31800835f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87c1b849c1441649e10d7931ca341e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:09Z,use_quota=True,user_id='2118264f5dfd499a98e9dec22351cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85593d9-bfb5-49e2-8bd3-d38fff66f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85593d9-bfb5-49e2-8bd3-d38fff66f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a91dd-d699-4ebf-992b-fbc4f3c0da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a91dd-d699-4ebf-992b-fbc4f3c0da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2395de18-262f-4a26-8125-af31800835f1', 'volume_name': 'volume-2395de18-262f-4a26-8125-af31800835f1', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b22141-30c9-4b05-8dc5-485509351a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b22141-30c9-4b05-8dc5-485509351a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d084e78b-b27a-4b40-87f5-4547414146fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Volume 2395de18-262f-4a26-8125-af31800835f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2395de18-262f-4a26-8125-af31800835f1', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 15:56:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Trying to clone 2395de18-262f-4a26-8125-af31800835f1 from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-f5d0b4a2-e98c-4f96-a291-4590fd2e513f-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-f5d0b4a2-e98c-4f96-a291-4590fd2e513f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-f5d0b4a2-e98c-4f96-a291-4590fd2e513f" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-f5d0b4a2-e98c-4f96-a291-4590fd2e513f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Deleting offline snapshot f5d0b4a2-e98c-4f96-a291-4590fd2e513f of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] snapshot_file for this snap is: volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a1cd04-9fa5-4047-818c-6e9007cdf26e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 15:56:10 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Image download 20.69 MB at 20.69 MB/s Jun 23 15:56:10 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f Jun 23 15:56:10 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28bee0-4e39-4d1e-ab1d-1531d82c14ed]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:10 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD Jun 23 15:56:10 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:11 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f" returned: 0 in 1.010s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bcc364-28dd-4ef1-ad92-8c9c05069925]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:11 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD" returned: 0 in 0.891s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 is fetched for user 2118264f5dfd499a98e9dec22351cc65. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 15:56:11 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:11 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[af751d3d-eb68-4c6a-be32-a67415451485]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:11 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD Jun 23 15:56:11 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:12 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD" returned: 0 in 1.230s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-320660099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2395de18-262f-4a26-8125-af31800835f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87c1b849c1441649e10d7931ca341e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:09Z,use_quota=True,user_id='2118264f5dfd499a98e9dec22351cc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Creating volume 2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:56:12 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:12 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1073741824 Jun 23 15:56:12 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:12 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.556s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:12 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f Jun 23 15:56:12 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:13 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f" returned: 0 in 1.085s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:13 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f Jun 23 15:56:13 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:14 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1073741824" returned: 0 in 1.250s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:14 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:14 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:15 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.f5d0b4a2-e98c-4f96-a291-4590fd2e513f" returned: 0 in 1.254s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:15 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 0 in 1.138s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-f5d0b4a2-e98c-4f96-a291-4590fd2e513f" released by "_delete_snapshot" :: held 5.068s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_snapshot" :: held 5.115s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Attempting download of 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 2395de18-262f-4a26-8125-af31800835f1. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Created reservations ['05a7bd22-0bbe-4bb0-9bcf-e12a5d9cccd3', 'e4018b58-00a1-4408-abee-ea830968d878', '2d29f8e8-3e70-4fd4-a936-63eb3e1fbc8a', '11fb1477-9375-47c4-af15-3b4eb47550db'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aca5e6-6bd2-4b0f-9ac9-43301cd74e1e]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Delete snapshot completed successfully. Jun 23 15:56:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fd42f76-de83-4f51-b971-a50c680966e3 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-f5d0b4a2-e98c-4f96-a291-4590fd2e513f-delete_snapshot" released by "delete_snapshot" :: held 5.454s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:15 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4 Jun 23 15:56:15 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Creating offline snapshot 3e8b5696-4d7f-4393-a909-46679e1090a3 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd2a232-d063-4112-8d5b-28501929293f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:16 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:16 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:16 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4" returned: 0 in 1.536s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:17 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4 Jun 23 15:56:17 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:17 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.460s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:17 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 1G Jun 23 15:56:17 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:17 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4" returned: 1 in 1.012s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_0k7q1aw4' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c888fb5-2fb1-4137-bd92-7cb1e4d74b3b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:18 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD Jun 23 15:56:18 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:19 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 1G" returned: 0 in 1.446s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:19 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 Jun 23 15:56:19 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:19 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD" returned: 0 in 1.326s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] 6aac4d99-2f53-4de8-8fee-643558b40ac5 was qcow2, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:19 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:19 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:19 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3" returned: 0 in 0.857s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:19 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 is being set with open permissions: ugo+rw Jun 23 15:56:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:19 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 Jun 23 15:56:19 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:21 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3" returned: 0 in 1.100s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.046s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-76af66a7-2bbb-425e-9c33-ffc83d6c0bcd tempest-SnapshotsActionsTest-881655375 None] Create snapshot completed successfully Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-3e8b5696-4d7f-4393-a909-46679e1090a3-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-3e8b5696-4d7f-4393-a909-46679e1090a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-3e8b5696-4d7f-4393-a909-46679e1090a3" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-3e8b5696-4d7f-4393-a909-46679e1090a3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Deleting offline snapshot 3e8b5696-4d7f-4393-a909-46679e1090a3 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] snapshot_file for this snap is: volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0a31b-06b3-42ed-8318-aeeae8e3cb6b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:21 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 Jun 23 15:56:21 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:22 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 0 in 2.785s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:22 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_0yx4yqb6devstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:56:22 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Converted 112.00 MB image at 40.17 MB/s Jun 23 15:56:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:22 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1G Jun 23 15:56:22 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:23 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3" returned: 0 in 1.317s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[79102213-d92c-467b-ad7a-dc4e53cf2e57]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:23 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 1G" returned: 0 in 1.063s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc365b7-a4ab-4e04-a556-acca74084f85]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:23 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:23 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:23 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:23 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:24 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.422s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:24 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 Jun 23 15:56:24 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:24 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 0 in 1.373s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:24 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:24 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:25 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 1 in 1.179s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Downloaded image 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 2395de18-262f-4a26-8125-af31800835f1 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 for user 2118264f5dfd499a98e9dec22351cc65 is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Marking volume 2395de18-262f-4a26-8125-af31800835f1 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Copying metadata from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 to 2395de18-262f-4a26-8125-af31800835f1. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Creating volume glance metadata for volume 2395de18-262f-4a26-8125-af31800835f1 backed by image 6aac4d99-2f53-4de8-8fee-643558b40ac5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 15:56:25 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3" returned: 0 in 1.353s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:25 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3 Jun 23 15:56:25 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d084e78b-b27a-4b40-87f5-4547414146fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2395de18-262f-4a26-8125-af31800835f1', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9f657e-7d5c-42b5-b288-e5f4852a6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:26 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Volume volume-2395de18-262f-4a26-8125-af31800835f1 (2395de18-262f-4a26-8125-af31800835f1): created successfully Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9f657e-7d5c-42b5-b288-e5f4852a6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Flow 'volume_create_manager' (907b6557-c3a9-4ce1-be75-fcc66168f710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e84b7421-5cbd-4bcf-9b8a-c1f6c42ee9ec tempest-VolumesImageMetadata-201329953 None] Created volume successfully. Jun 23 15:56:26 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.3e8b5696-4d7f-4393-a909-46679e1090a3" returned: 0 in 0.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-3e8b5696-4d7f-4393-a909-46679e1090a3" released by "_delete_snapshot" :: held 4.925s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_snapshot" :: held 4.968s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Created reservations ['837c4665-7615-410d-b677-6a2b33244351', '85c9751b-d3d6-444e-9117-58c45ae27626', '9f39440f-e0a1-442e-8b22-268affaaa248', '0f3a744c-c2a3-48db-becd-e8593ee3eb66'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Acquiring lock "cinder-2395de18-262f-4a26-8125-af31800835f1-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "cinder-2395de18-262f-4a26-8125-af31800835f1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Delete snapshot completed successfully. Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-02ea13d3-c9af-4617-a405-9e166bff22bb tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-3e8b5696-4d7f-4393-a909-46679e1090a3-delete_snapshot" released by "delete_snapshot" :: held 5.201s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Acquiring lock "cinder-quobyte-2395de18-262f-4a26-8125-af31800835f1" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "cinder-quobyte-2395de18-262f-4a26-8125-af31800835f1" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2839d5-0129-4162-8e0f-a1e263de5220]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:27 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:27 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Creating offline snapshot de63210c-9f8d-4772-b11f-8647ff283633 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:56:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26efa85-72a9-4050-b7e3-4443fe762e15]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:27 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:27 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:28 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 0 in 1.211s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:28 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:28 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:28 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 0.910s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:28 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 1G Jun 23 15:56:28 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:28 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 1 in 0.865s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 15:56:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:28 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1 Jun 23 15:56:28 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:29 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 1G" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:29 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 Jun 23 15:56:29 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:29 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2395de18-262f-4a26-8125-af31800835f1" returned: 0 in 0.797s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "cinder-quobyte-2395de18-262f-4a26-8125-af31800835f1" released by "delete_volume" :: held 2.947s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Created reservations ['3e150705-03d7-41e9-afe8-3cabbd23e261', 'cd2b34a1-7ec8-4131-9cab-1dfbf9e634b2', 'cad4cd18-3068-4e99-a9ab-8b88ce73622f', 'f4c5e4df-0c04-4df1-acb0-87b910c6b458'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:29 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:56:29 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:30 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633" returned: 0 in 0.977s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:30 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 is being set with open permissions: ugo+rw Jun 23 15:56:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:30 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 Jun 23 15:56:30 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:30 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.830s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:30 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:56:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Deleted volume successfully. Jun 23 15:56:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d76d9266-9d65-404f-9e85-86aa50bdbf8a tempest-VolumesImageMetadata-201329953 None] Lock "cinder-2395de18-262f-4a26-8125-af31800835f1-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:31 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633" returned: 0 in 0.795s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-28e50c76-e5c0-4cda-a5da-37e367bc8c34 tempest-SnapshotsActionsTest-881655375 None] Create snapshot completed successfully Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-de63210c-9f8d-4772-b11f-8647ff283633-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-de63210c-9f8d-4772-b11f-8647ff283633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Acquiring lock "cinder-quobyte-de63210c-9f8d-4772-b11f-8647ff283633" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-de63210c-9f8d-4772-b11f-8647ff283633" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Deleting offline snapshot de63210c-9f8d-4772-b11f-8647ff283633 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] snapshot_file for this snap is: volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba5c53-55d1-4b15-9f1e-fbdef985e192]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:32 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 Jun 23 15:56:32 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:32 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633" returned: 0 in 0.889s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bdf32-89b2-4ba4-9d8e-98783b3a367f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:33 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:33 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:33 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:56:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Flow 'volume_create_manager' (d377b9b5-503a-4ed9-af09-2089921eed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be0a04-64b8-46d3-beca-18f8b3fd2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be0a04-64b8-46d3-beca-18f8b3fd2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1532812352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845c33a1-4db7-497b-9375-6aa08ac1c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ddaa970280489db16f6d4e167e98a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:34Z,use_quota=True,user_id='4594155d2d164436877e17ac528e5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8640c262-389e-498a-800b-221c8e6d119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8640c262-389e-498a-800b-221c8e6d119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:34 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f32921-9c7a-4d1d-83f9-a4b49d88c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f32921-9c7a-4d1d-83f9-a4b49d88c015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845c33a1-4db7-497b-9375-6aa08ac1c6a5', 'volume_name': 'volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46b33ff-ae19-4621-84c7-582e3792b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46b33ff-ae19-4621-84c7-582e3792b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8ffc5-fcae-4b21-a796-b07415bed42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:34 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Volume 845c33a1-4db7-497b-9375-6aa08ac1c6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5', 'volume_size': 1} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1532812352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845c33a1-4db7-497b-9375-6aa08ac1c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ddaa970280489db16f6d4e167e98a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:34Z,use_quota=True,user_id='4594155d2d164436877e17ac528e5bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Creating volume 845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:56:34 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 1.092s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:34 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 1073741824 Jun 23 15:56:34 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:34 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 Jun 23 15:56:34 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:34 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633" returned: 0 in 0.824s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:34 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633 Jun 23 15:56:34 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:34 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 1073741824" returned: 0 in 0.908s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:35 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 Jun 23 15:56:35 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:35 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.de63210c-9f8d-4772-b11f-8647ff283633" returned: 0 in 0.661s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-de63210c-9f8d-4772-b11f-8647ff283633" released by "_delete_snapshot" :: held 3.593s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_snapshot" :: held 3.620s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:35 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5" returned: 0 in 0.628s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Created reservations ['90004624-be41-4ced-b72b-88869554225f', '7ff1d968-46f8-49ff-a2a7-841b578e22c6', '1d8a9dc0-441b-429e-b411-e8faf840c9e8', 'a4dc1a65-2c9a-4461-bf56-70ad55862f27'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8ffc5-fcae-4b21-a796-b07415bed42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de86a87c-5310-4465-8229-16eca826fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:35 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Volume volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 (845c33a1-4db7-497b-9375-6aa08ac1c6a5): created successfully Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de86a87c-5310-4465-8229-16eca826fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Flow 'volume_create_manager' (d377b9b5-503a-4ed9-af09-2089921eed9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-44515daa-68b0-49bc-ab84-0bb145eb7315 tempest-SnapshotMetadataTestJSON-1756215839 None] Created volume successfully. Jun 23 15:56:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Delete snapshot completed successfully. Jun 23 15:56:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd44c0f7-c90c-4e97-8358-156815f12bc5 tempest-SnapshotsActionsTest-1119513316 None] Lock "cinder-de63210c-9f8d-4772-b11f-8647ff283633-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Creating offline snapshot 089a1f40-01d1-417a-b176-1eea7b71bb21 of volume 845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d0251-ad03-4648-ab84-428a1a1e5604]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:36 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 Jun 23 15:56:36 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "cinder-c65042bd-a44a-4320-a79a-abdee1fa15a4-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-c65042bd-a44a-4320-a79a-abdee1fa15a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "cinder-quobyte-c65042bd-a44a-4320-a79a-abdee1fa15a4" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-c65042bd-a44a-4320-a79a-abdee1fa15a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Deleting offline snapshot c65042bd-a44a-4320-a79a-abdee1fa15a4 of volume 8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] snapshot_file for this snap is: volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[03513f85-37e6-48ce-8e91-d9f1419a38ea]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:36 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:36 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:37 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5" returned: 0 in 0.832s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:37 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 1G Jun 23 15:56:37 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:37 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 0.937s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c33ac1-8d22-409d-9454-91b057a3039d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:37 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a Jun 23 15:56:37 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=58,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=24 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (d88ed9f8-18d8-4050-810e-c9bbc1b75fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5b6f1f-6bd2-4012-83c8-9ba812fdc424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5b6f1f-6bd2-4012-83c8-9ba812fdc424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958471548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfba1b4d-0182-412c-81cd-bbdeccc3f01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:38Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f448d59-8cb0-4a19-937d-d4508a3d7179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f448d59-8cb0-4a19-937d-d4508a3d7179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdfdafb-a5e7-458c-91b9-b18584850a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdfdafb-a5e7-458c-91b9-b18584850a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfba1b4d-0182-412c-81cd-bbdeccc3f01f', 'volume_name': 'volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889f430-350d-4891-87db-b87129a76d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889f430-350d-4891-87db-b87129a76d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce130038-eb77-4475-b2b5-58678886babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:38 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Volume bfba1b4d-0182-412c-81cd-bbdeccc3f01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f', 'volume_size': 1} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:38 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 1G" returned: 0 in 1.244s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:38 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 Jun 23 15:56:38 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:38 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" returned: 0 in 1.152s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:38 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:38 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:39 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21" returned: 0 in 1.100s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:39 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 is being set with open permissions: ugo+rw Jun 23 15:56:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:39 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 Jun 23 15:56:39 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:39 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 0.986s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:39 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4 Jun 23 15:56:39 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:40 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21" returned: 0 in 0.829s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=62,cinder:SELECT=72,cinder:INSERT=22,cinder:DELETE=6 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:40 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info Jun 23 15:56:40 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:40 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a.c65042bd-a44a-4320-a79a-abdee1fa15a4" returned: 0 in 0.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-c65042bd-a44a-4320-a79a-abdee1fa15a4" released by "_delete_snapshot" :: held 3.888s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_snapshot" :: held 3.912s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Created reservations ['b36d813f-9bfc-499d-88e2-47d0dd3c22ac', 'ca9e6c1e-7f24-4534-9afb-95a9dc3413d7', 'f9660013-250a-4941-bb44-608c6509a606', '5c639d95-9867-481f-a0fb-d80dcffd8e57'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Delete snapshot completed successfully. Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4db347d5-1dc2-41eb-a695-d8823f3c3607 tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-c65042bd-a44a-4320-a79a-abdee1fa15a4-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "cinder-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:41 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info" returned: 0 in 0.676s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:41 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info is being set with open permissions: ugo+rw Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:41 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info Jun 23 15:56:41 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb9107-a28d-436e-a4b3-af307d599a68]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:41 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a Jun 23 15:56:41 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:41 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.info" returned: 0 in 0.653s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.441s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.349s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958471548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfba1b4d-0182-412c-81cd-bbdeccc3f01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:38Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Creating volume bfba1b4d-0182-412c-81cd-bbdeccc3f01f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:56:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:56:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:41 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f 1073741824 Jun 23 15:56:41 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:41 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fce91964-1382-4ca7-a1b0-3952dad39c34 tempest-SnapshotMetadataTestJSON-1756215839 None] Create snapshot completed successfully Jun 23 15:56:42 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" returned: 0 in 0.855s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:42 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a Jun 23 15:56:42 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:42 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f 1073741824" returned: 0 in 0.961s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:42 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" returned: 0 in 0.739s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:42 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f Jun 23 15:56:42 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-quobyte-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a" released by "delete_volume" :: held 1.692s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Created reservations ['f1969d1c-432d-41ed-8963-3e1aee6241d5', '779854ab-461c-4201-8d24-4efe470682d0', '48ae4e88-8c59-4e60-a3c0-7cf9b9f97243', '8555294f-aef3-4a83-a9ae-ba2d841fc148'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:42 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:56:42 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "cinder-089a1f40-01d1-417a-b176-1eea7b71bb21-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-089a1f40-01d1-417a-b176-1eea7b71bb21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "cinder-quobyte-089a1f40-01d1-417a-b176-1eea7b71bb21" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-089a1f40-01d1-417a-b176-1eea7b71bb21" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Deleting offline snapshot 089a1f40-01d1-417a-b176-1eea7b71bb21 of volume 845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:56:43 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] snapshot_file for this snap is: volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" returned: 0 in 0.976s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a55cc71-8cb0-4be5-9fb8-78ef4f8d1d2c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce130038-eb77-4475-b2b5-58678886babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec05455-29a9-4c9a-acce-fdb7aec975df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:43 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Volume volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f (bfba1b4d-0182-412c-81cd-bbdeccc3f01f): created successfully Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec05455-29a9-4c9a-acce-fdb7aec975df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (d88ed9f8-18d8-4050-810e-c9bbc1b75fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dc859199-c491-49e3-be97-7d7e9961d75c tempest-AttachVolumeNegativeTest-343860166 None] Created volume successfully. Jun 23 15:56:43 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 Jun 23 15:56:43 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:44 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.124s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:56:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Deleted volume successfully. Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0d5753d-3223-4463-bc9a-db22b4c6e48c tempest-SnapshotsActionsTest-881655375 None] Lock "cinder-8c68c49c-8778-44d3-9c4c-0c3aa1a8627a-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:44 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21" returned: 0 in 0.983s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6332dfcd-f9d7-4b6c-b871-f0334d182733]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:44 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 Jun 23 15:56:44 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:45 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:45 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 Jun 23 15:56:45 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:47 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21" returned: 0 in 1.409s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:47 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21 Jun 23 15:56:47 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:48 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5.089a1f40-01d1-417a-b176-1eea7b71bb21" returned: 0 in 1.060s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543254b-b004-4588-8963-03b4ef0fdcef]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-089a1f40-01d1-417a-b176-1eea7b71bb21" released by "_delete_snapshot" :: held 4.540s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" released by "delete_snapshot" :: held 4.591s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:48 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f Jun 23 15:56:48 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Created reservations ['5d605722-bfad-40be-a0b2-6dae846d191e', '83f2a20a-fa49-4592-ab8a-862dc603568a', 'e48d56e2-3b9a-411a-864a-9b58aaff92d2', 'a04c035b-f70a-42e9-b7a1-289bda5e1a9d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Delete snapshot completed successfully. Jun 23 15:56:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dbe6ab07-504d-4e4d-89a2-920dad139497 tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-089a1f40-01d1-417a-b176-1eea7b71bb21-delete_snapshot" released by "delete_snapshot" :: held 4.895s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "cinder-845c33a1-4db7-497b-9375-6aa08ac1c6a5-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-845c33a1-4db7-497b-9375-6aa08ac1c6a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:49 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" returned: 0 in 1.084s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.144s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" acquired by "delete_volume" :: waited 0.043s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c4488e-6493-4c75-9aac-4be356131a9f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '726d1570-8038-43ca-9442-5965e411b435', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:56:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-98361dad-391f-44b0-a682-ee017911eba6 req-15c2776f-7103-4d20-948f-715f85d7308d tempest-AttachVolumeNegativeTest-343860166 None] attachment_update completed successfully. Jun 23 15:56:49 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 Jun 23 15:56:49 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:50 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5" returned: 0 in 1.523s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:50 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5 Jun 23 15:56:50 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:51 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-845c33a1-4db7-497b-9375-6aa08ac1c6a5" returned: 0 in 1.081s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-quobyte-845c33a1-4db7-497b-9375-6aa08ac1c6a5" released by "delete_volume" :: held 2.695s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Created reservations ['de57bf7b-3fe7-4b26-a5b8-c71bf74672d6', '0a8c4e76-32ca-4c6d-99af-aeb4e9172cd8', '901b72b3-c9a8-4b26-b9dc-f4d9e279f0f8', '87e4aa7e-eadd-4737-a065-584745078781'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:52 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:56:52 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:53 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.977s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:53 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:56:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Deleted volume successfully. Jun 23 15:56:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0729d27e-5d75-480d-8df5-846ad5fae72f tempest-SnapshotMetadataTestJSON-1756215839 None] Lock "cinder-845c33a1-4db7-497b-9375-6aa08ac1c6a5-delete_volume" released by "delete_volume" :: held 4.120s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (ce74b769-f0a4-4933-bc98-9a48090fcb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba2bc1-cca9-4702-a4c9-f536fdfd88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba2bc1-cca9-4702-a4c9-f536fdfd88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1459023323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8234ac69-6fc2-4db1-a248-9551b3e2dcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc43a068ae1b4e32ae3cad02e575a460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:57Z,use_quota=True,user_id='0608ddbfa69447fd93c5498916eb714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f36228-98eb-430a-8a54-200a8bc72b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f36228-98eb-430a-8a54-200a8bc72b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bce05f-951a-4cab-bc49-e12122817cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bce05f-951a-4cab-bc49-e12122817cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8234ac69-6fc2-4db1-a248-9551b3e2dcbb', 'volume_name': 'volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae88967-0a11-4f95-8e07-da1235bb5b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae88967-0a11-4f95-8e07-da1235bb5b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86850d95-d119-465a-95f0-2b2f8aca2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:57 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb', 'volume_size': 1} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1459023323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8234ac69-6fc2-4db1-a248-9551b3e2dcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc43a068ae1b4e32ae3cad02e575a460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:56:57Z,use_quota=True,user_id='0608ddbfa69447fd93c5498916eb714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Creating volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:56:57 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:56:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:57 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb 1073741824 Jun 23 15:56:57 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:58 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb 1073741824" returned: 0 in 1.123s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:56:58 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:56:58 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:56:59 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 0.940s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86850d95-d119-465a-95f0-2b2f8aca2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5039605-8b1c-4d41-b14e-e62cb8c651c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:56:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Volume volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb (8234ac69-6fc2-4db1-a248-9551b3e2dcbb): created successfully Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5039605-8b1c-4d41-b14e-e62cb8c651c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:56:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (ce74b769-f0a4-4933-bc98-9a48090fcb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:56:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c9980c8f-fa53-49c5-bbab-0d38f7c9d6d5 tempest-VolumesDeleteCascade-1947637600 None] Created volume successfully. Jun 23 15:57:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Creating offline snapshot 2b743866-c17d-4b8c-8af4-e288f2e43e63 of volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:57:00 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d96e2-338d-4022-b0d0-4656a9b708a9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:00 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:00 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:01 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 0.968s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:01 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 1G Jun 23 15:57:01 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:02 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 1G" returned: 0 in 0.900s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:02 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:02 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:03 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 0.800s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:03 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 is being set with open permissions: ugo+rw Jun 23 15:57:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:03 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:03 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:04 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 0.719s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:04 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info Jun 23 15:57:04 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:05 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info" returned: 0 in 0.799s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:05 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info is being set with open permissions: ugo+rw Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:05 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info Jun 23 15:57:05 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:05 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:57:05 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:05 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.info" returned: 0 in 0.829s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.156s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9827368a-4540-479a-b13c-11dc84c17f80 tempest-VolumesDeleteCascade-1947637600 None] Create snapshot completed successfully Jun 23 15:57:06 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:57:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:57:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:57:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:57:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Creating offline snapshot 6bb7b4ba-ea91-4b64-93cf-04ad62b55911 of volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:57:07 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a3521-248e-4c12-b111-6208a1696cf6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:07 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:07 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:08 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 0.878s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:08 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 1G Jun 23 15:57:08 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:09 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 1G" returned: 0 in 1.006s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:09 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:09 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:10 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 0.791s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:10 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 is being set with open permissions: ugo+rw Jun 23 15:57:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:10 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:10 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:11 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 0.878s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.696s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d6fa31da-e5f6-4fd6-86cc-1e3940c99364 tempest-VolumesDeleteCascade-1947637600 None] Create snapshot completed successfully Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-8234ac69-6fc2-4db1-a248-9551b3e2dcbb-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-8234ac69-6fc2-4db1-a248-9551b3e2dcbb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Performing cascade delete. {{(pid=93590) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-2b743866-c17d-4b8c-8af4-e288f2e43e63-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-2b743866-c17d-4b8c-8af4-e288f2e43e63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-2b743866-c17d-4b8c-8af4-e288f2e43e63" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-2b743866-c17d-4b8c-8af4-e288f2e43e63" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Deleting offline snapshot 2b743866-c17d-4b8c-8af4-e288f2e43e63 of volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] snapshot_file for this snap is: volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead0ede-93e6-4fec-9960-4a160d68acd9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:12 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:12 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (a6dfabea-30a7-4156-8674-38db13ea7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1a6fd0-a7e5-4dee-844e-703890b6650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1a6fd0-a7e5-4dee-844e-703890b6650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1850256469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f7d323-34f5-47e9-8c11-b58e9deb8440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:12Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4737141-12e6-4cd1-ad29-e67799cd1bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4737141-12e6-4cd1-ad29-e67799cd1bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d143237-a165-4733-8ad6-3d7c686150b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d143237-a165-4733-8ad6-3d7c686150b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f7d323-34f5-47e9-8c11-b58e9deb8440', 'volume_name': 'volume-17f7d323-34f5-47e9-8c11-b58e9deb8440', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed4b78c-905c-4b2a-8d3e-b3665c7ba2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed4b78c-905c-4b2a-8d3e-b3665c7ba2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868ae879-7745-4a53-94a9-7ea5790e0bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:12 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Volume 17f7d323-34f5-47e9-8c11-b58e9deb8440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f7d323-34f5-47e9-8c11-b58e9deb8440', 'volume_size': 1} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1850256469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f7d323-34f5-47e9-8c11-b58e9deb8440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:12Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Creating volume 17f7d323-34f5-47e9-8c11-b58e9deb8440 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:57:12 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:57:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:12 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 1073741824 Jun 23 15:57:12 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:13 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 1.269s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d7e8c-c5d0-4890-9f2c-bdb414942592]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:13 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:13 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:14 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 1073741824" returned: 0 in 1.454s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:14 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 Jun 23 15:57:14 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:14 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 1.353s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:14 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7012c5d-f93f-48f0-8e8f-c9ee07eff2b1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:15 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:15 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:15 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440" returned: 0 in 1.004s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868ae879-7745-4a53-94a9-7ea5790e0bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f7d323-34f5-47e9-8c11-b58e9deb8440', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08f624c-44af-4007-bcea-72394d733305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Volume volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 (17f7d323-34f5-47e9-8c11-b58e9deb8440): created successfully Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08f624c-44af-4007-bcea-72394d733305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (a6dfabea-30a7-4156-8674-38db13ea7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9f374044-c3de-49c1-b99b-ef0ef09beeb8 tempest-AttachVolumeTestJSON-1963781098 None] Created volume successfully. Jun 23 15:57:16 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 1.392s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:16 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c23a99-353e-49db-bcb5-a4c8397408fb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:16 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:16 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:17 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 1.218s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e07ec7-0d07-49f0-9520-218dc96dbfad]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:17 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:17 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:19 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 1.655s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:19 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:19 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c4b6e-bad0-4a01-85a9-3f3b2401b717]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:20 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 Jun 23 15:57:20 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:20 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 1.749s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:20 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63 Jun 23 15:57:20 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:21 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440" returned: 0 in 1.265s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.312s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-17f7d323-34f5-47e9-8c11-b58e9deb8440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2467877d-990d-44b0-8750-80b37774f631', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:57:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-9f5cb3f6-973e-4b96-ba54-2cd0f116e969 req-193c8e66-d517-4af4-9b23-e2f65ed70408 tempest-AttachVolumeTestJSON-1963781098 None] attachment_update completed successfully. Jun 23 15:57:22 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.2b743866-c17d-4b8c-8af4-e288f2e43e63" returned: 0 in 1.361s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 -F qcow2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:22 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 -F qcow2 Jun 23 15:57:22 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:23 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 -F qcow2" returned: 0 in 0.904s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-2b743866-c17d-4b8c-8af4-e288f2e43e63" released by "_delete_snapshot" :: held 11.217s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" released by "delete_snapshot" :: held 11.251s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['aa416727-9548-4ae4-a535-a1b81f83e679', '1c1f9d6e-adbe-4811-9874-c0228cb4229d', '9ebe0431-ae77-4da0-8ff7-a433753042e5', 'da842dce-7d04-4abf-b341-73c140d99c22'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:57:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Delete snapshot completed successfully. Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-2b743866-c17d-4b8c-8af4-e288f2e43e63-delete_snapshot" released by "delete_snapshot" :: held 11.605s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-6bb7b4ba-ea91-4b64-93cf-04ad62b55911-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-6bb7b4ba-ea91-4b64-93cf-04ad62b55911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-6bb7b4ba-ea91-4b64-93cf-04ad62b55911" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-6bb7b4ba-ea91-4b64-93cf-04ad62b55911" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Deleting offline snapshot 6bb7b4ba-ea91-4b64-93cf-04ad62b55911 of volume 8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] snapshot_file for this snap is: volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa415621-ba98-4c96-a95b-81f29aed4a12]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:23 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:23 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:24 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 0.945s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd74f6-9a67-430c-b221-a15aaa19da22]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:24 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:24 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:25 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 0.922s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:25 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:25 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:26 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 0.911s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:26 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911 Jun 23 15:57:26 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:27 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb.6bb7b4ba-ea91-4b64-93cf-04ad62b55911" returned: 0 in 0.966s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-6bb7b4ba-ea91-4b64-93cf-04ad62b55911" released by "_delete_snapshot" :: held 3.881s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" released by "delete_snapshot" :: held 3.915s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['60c62552-7e7d-4c35-9dcf-3f200dbc1e5b', '6e467263-f528-4d7a-8ab5-faf2c5695872', '3606974e-04ad-4a13-bf5b-60a2556b1011', 'd4363e24-8757-4e23-b690-43f891ca0d6e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:57:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Delete snapshot completed successfully. Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-6bb7b4ba-ea91-4b64-93cf-04ad62b55911-delete_snapshot" released by "delete_snapshot" :: held 4.091s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Snapshots deleted, issuing volume delete {{(pid=93590) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3692bec-2db1-42eb-9350-476248837aed]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:27 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:27 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:28 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 1.170s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:28 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb Jun 23 15:57:28 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:29 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" returned: 0 in 0.758s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-8234ac69-6fc2-4db1-a248-9551b3e2dcbb" released by "delete_volume" :: held 2.012s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['9d8b22ef-9ecd-4848-8587-0ae7d8a880ff', 'd494cda4-fa79-4193-8b1f-c87e6a137dbc', 'ef498ec5-211d-4acd-9557-1441fa38a63d', '1e78b1c9-96be-42ac-af6f-20e2dd1e7e86'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:29 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:57:29 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:30 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.931s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:30 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:57:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Deleted volume successfully. Jun 23 15:57:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9a08739b-c549-4100-b5f2-ed1beb029726 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-8234ac69-6fc2-4db1-a248-9551b3e2dcbb-delete_volume" released by "delete_volume" :: held 19.020s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (af7d2f9b-aafb-407c-8c47-8c9ad066410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188d6f2d-a787-4d5b-9b1f-e60b3784e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188d6f2d-a787-4d5b-9b1f-e60b3784e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1030942472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552a738-58fc-448a-8289-568142aef62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc43a068ae1b4e32ae3cad02e575a460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:31Z,use_quota=True,user_id='0608ddbfa69447fd93c5498916eb714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980d236-c9a2-445c-8ff8-e4114f20976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980d236-c9a2-445c-8ff8-e4114f20976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398323fa-e538-4fa0-bf16-ada44e985ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398323fa-e538-4fa0-bf16-ada44e985ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a552a738-58fc-448a-8289-568142aef62d', 'volume_name': 'volume-a552a738-58fc-448a-8289-568142aef62d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fad2dc-fd91-40a2-93a6-bd3781a3f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fad2dc-fd91-40a2-93a6-bd3781a3f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fadb39-72ea-4d33-92ad-42dca64a78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:31 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Volume a552a738-58fc-448a-8289-568142aef62d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a552a738-58fc-448a-8289-568142aef62d', 'volume_size': 1} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1030942472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552a738-58fc-448a-8289-568142aef62d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc43a068ae1b4e32ae3cad02e575a460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:31Z,use_quota=True,user_id='0608ddbfa69447fd93c5498916eb714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Creating volume a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:57:31 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:57:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:31 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d 1073741824 Jun 23 15:57:31 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:32 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d 1073741824" returned: 0 in 1.048s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:32 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:57:32 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:33 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 0.824s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fadb39-72ea-4d33-92ad-42dca64a78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a552a738-58fc-448a-8289-568142aef62d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb84325-a245-4d80-833e-9b70eb19537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Volume volume-a552a738-58fc-448a-8289-568142aef62d (a552a738-58fc-448a-8289-568142aef62d): created successfully Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb84325-a245-4d80-833e-9b70eb19537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (af7d2f9b-aafb-407c-8c47-8c9ad066410a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-458d9a92-b9a5-4574-b0c3-cf4fdbc77547 tempest-VolumesDeleteCascade-1947637600 None] Created volume successfully. Jun 23 15:57:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Creating offline snapshot 43f24dc4-0443-499b-ae9a-97f6f56ef171 of volume a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:57:34 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5d709-1bc4-4710-a9ed-1d0f897ffcf0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:34 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:57:34 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:35 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 0.918s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:35 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 1G Jun 23 15:57:35 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:36 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 1G" returned: 0 in 0.859s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a552a738-58fc-448a-8289-568142aef62d -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:36 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a552a738-58fc-448a-8289-568142aef62d -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:57:36 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:37 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a552a738-58fc-448a-8289-568142aef62d -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 0.733s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:37 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 is being set with open permissions: ugo+rw Jun 23 15:57:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:37 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:57:37 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:37 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 0.645s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:37 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info Jun 23 15:57:37 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:38 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info" returned: 0 in 0.652s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:38 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info is being set with open permissions: ugo+rw Jun 23 15:57:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:38 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info Jun 23 15:57:38 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:39 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.info" returned: 0 in 0.703s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=70,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=7 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:57:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-95ee072f-dd39-4b68-9195-82b503dcfcc5 tempest-VolumesDeleteCascade-1947637600 None] Create snapshot completed successfully Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (c48e306f-55fc-4b6f-a20a-24550a7d1008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1e5354-a342-4882-85a1-cf61cdfe010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=63,cinder:INSERT=15,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1e5354-a342-4882-85a1-cf61cdfe010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1798685163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935d2e2e-7483-4b07-82e7-6ed5ce904940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc43a068ae1b4e32ae3cad02e575a460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43f24dc4-0443-499b-ae9a-97f6f56ef171,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:41Z,use_quota=True,user_id='0608ddbfa69447fd93c5498916eb714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7b86ac-d693-4ace-890a-89dd52570033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7b86ac-d693-4ace-890a-89dd52570033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64cd11d-b79c-4c9c-9619-0b7f931f210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64cd11d-b79c-4c9c-9619-0b7f931f210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '935d2e2e-7483-4b07-82e7-6ed5ce904940', 'volume_name': 'volume-935d2e2e-7483-4b07-82e7-6ed5ce904940', 'volume_size': 1, 'snapshot_id': '43f24dc4-0443-499b-ae9a-97f6f56ef171'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee875c7f-6111-4fe0-b0bb-806af6abf3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee875c7f-6111-4fe0-b0bb-806af6abf3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf4b2d7-8e14-4dad-809e-0d2c2ae652c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Volume 935d2e2e-7483-4b07-82e7-6ed5ce904940: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-935d2e2e-7483-4b07-82e7-6ed5ce904940', 'volume_size': 1, 'snapshot_id': '43f24dc4-0443-499b-ae9a-97f6f56ef171'} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171-935d2e2e-7483-4b07-82e7-6ed5ce904940" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171-935d2e2e-7483-4b07-82e7-6ed5ce904940" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Creating volume 935d2e2e-7483-4b07-82e7-6ed5ce904940 from snapshot 43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:57:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] snapshot: 43f24dc4-0443-499b-ae9a-97f6f56ef171, volume: 935d2e2e-7483-4b07-82e7-6ed5ce904940, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5e03c-492f-4ab2-a265-f642455e241f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:41 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:57:41 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:42 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 1.518s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a552a738-58fc-448a-8289-568142aef62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adedc5a-c81b-4f67-8612-6f9e1edc7e35]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:42 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:57:42 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:44 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 1.419s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:44 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 15:57:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:44 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 Jun 23 15:57:44 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:52 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940" returned: 0 in 8.660s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:52 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087fd09-87f8-4cfe-9ba4-451412a4532e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:52 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:57:52 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:54 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 1.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:54 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:57:54 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Converted 1024.00 MB image at 118.19 MB/s Jun 23 15:57:54 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 is being set with open permissions: ugo+rw Jun 23 15:57:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:54 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 Jun 23 15:57:54 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-157efa9c-d8ad-46d8-ac9d-a5e189f0c5f0 req-e536e63a-90a4-4db4-a71a-5bfda3805fc0 tempest-AttachVolumeNegativeTest-343860166 None] Terminate volume connection completed successfully. Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-157efa9c-d8ad-46d8-ac9d-a5e189f0c5f0 req-e536e63a-90a4-4db4-a71a-5bfda3805fc0 tempest-AttachVolumeNegativeTest-343860166 None] Deleting attachment 726d1570-8038-43ca-9442-5965e411b435. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:57:55 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940" returned: 0 in 0.978s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" released by "_copy_volume_from_snapshot" :: held 14.510s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171-935d2e2e-7483-4b07-82e7-6ed5ce904940" released by "_create_volume_from_snapshot" :: held 14.591s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.623s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf4b2d7-8e14-4dad-809e-0d2c2ae652c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935d2e2e-7483-4b07-82e7-6ed5ce904940', 'volume_size': 1, 'snapshot_id': '43f24dc4-0443-499b-ae9a-97f6f56ef171'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0015c1-3e25-40a6-aa97-a45a447d59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Volume volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 (935d2e2e-7483-4b07-82e7-6ed5ce904940): created successfully Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0015c1-3e25-40a6-aa97-a45a447d59aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Flow 'volume_create_manager' (c48e306f-55fc-4b6f-a20a-24550a7d1008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-19bfa163-f93a-4d23-a419-97b82ed4c569 tempest-VolumesDeleteCascade-1947637600 None] Created volume successfully. Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-a552a738-58fc-448a-8289-568142aef62d-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-a552a738-58fc-448a-8289-568142aef62d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Performing cascade delete. {{(pid=93590) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-43f24dc4-0443-499b-ae9a-97f6f56ef171-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-43f24dc4-0443-499b-ae9a-97f6f56ef171-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Deleting offline snapshot 43f24dc4-0443-499b-ae9a-97f6f56ef171 of volume a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] snapshot_file for this snap is: volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e7ac8-6283-435e-be68-26f118fc3233]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:56 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:57:56 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:57 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 1.244s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a552a738-58fc-448a-8289-568142aef62d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:57:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be725f8-262f-4024-88dd-a5b1a3f755ca]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:57:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:57 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:57:57 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3f9c97ec-d05d-456b-9d66-68d18d8f93d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a9aa09-9c15-4d49-ba1d-e1bd1e0524f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a9aa09-9c15-4d49-ba1d-e1bd1e0524f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304042377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d09a2fa-f488-4423-83e9-48dd4677280f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:58Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85293958-cbf8-4c4f-8186-5789a7060942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85293958-cbf8-4c4f-8186-5789a7060942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee847ec7-0338-4dc0-8050-711e961e71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee847ec7-0338-4dc0-8050-711e961e71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d09a2fa-f488-4423-83e9-48dd4677280f', 'volume_name': 'volume-9d09a2fa-f488-4423-83e9-48dd4677280f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdfb8c7-48c6-4eea-9791-e9439a223c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdfb8c7-48c6-4eea-9791-e9439a223c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa308a2-f49d-4ef5-a56f-1c2ec7cb415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:57:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Volume 9d09a2fa-f488-4423-83e9-48dd4677280f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d09a2fa-f488-4423-83e9-48dd4677280f', 'volume_size': 1} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304042377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d09a2fa-f488-4423-83e9-48dd4677280f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:57:58Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Creating volume 9d09a2fa-f488-4423-83e9-48dd4677280f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:57:58 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:57:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:58 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f 1073741824 Jun 23 15:57:58 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:59 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 1.468s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:59 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:57:59 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:57:59 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jun 23 15:57:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f 1073741824" returned: 0 in 1.149s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:57:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:57:59 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f Jun 23 15:57:59 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:00 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 0.917s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:00 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171 Jun 23 15:58:00 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:00 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f" returned: 0 in 0.696s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa308a2-f49d-4ef5-a56f-1c2ec7cb415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d09a2fa-f488-4423-83e9-48dd4677280f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9cbab8-139d-4699-a507-a9d2f5f1c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Volume volume-9d09a2fa-f488-4423-83e9-48dd4677280f (9d09a2fa-f488-4423-83e9-48dd4677280f): created successfully Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9cbab8-139d-4699-a507-a9d2f5f1c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3f9c97ec-d05d-456b-9d66-68d18d8f93d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5736dd08-c5e7-40db-bcc8-0498f48092a6 tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-662e7131-9b45-4f3b-a372-7cd897be37a3 tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f" by "attach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-662e7131-9b45-4f3b-a372-7cd897be37a3 tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f" acquired by "attach_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-662e7131-9b45-4f3b-a372-7cd897be37a3 tempest-VolumesActionsTest-516139392 None] Attaching volume 9d09a2fa-f488-4423-83e9-48dd4677280f to instance bac075bb-678c-47e3-9bb3-12d145aa81b4 at mountpoint /dev/vdb on host None. Jun 23 15:58:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-662e7131-9b45-4f3b-a372-7cd897be37a3 tempest-VolumesActionsTest-516139392 None] Attach volume completed successfully. Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-662e7131-9b45-4f3b-a372-7cd897be37a3 tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f" released by "attach_volume" :: held 0.193s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:01 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d.43f24dc4-0443-499b-ae9a-97f6f56ef171" returned: 0 in 1.034s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-43f24dc4-0443-499b-ae9a-97f6f56ef171" released by "_delete_snapshot" :: held 4.813s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" released by "delete_snapshot" :: held 4.838s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['344d30c3-06bb-40c2-b381-45d7a8a0374a', '9fd1c105-5660-4eb3-abbf-09032be355f3', 'dcb0496c-4793-45aa-b5e6-e7dc538b2dfa', 'f3c5c2b9-5944-4c1c-8c8d-54a0cfad0dee'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Delete snapshot completed successfully. Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-43f24dc4-0443-499b-ae9a-97f6f56ef171-delete_snapshot" released by "delete_snapshot" :: held 4.989s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Snapshots deleted, issuing volume delete {{(pid=93590) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c7512-3a5c-414a-8dd2-c9d9b79aa2db]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:01 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:58:01 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Terminate volume connection completed successfully. Jun 23 15:58:02 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 0.842s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:02 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d Jun 23 15:58:02 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" by "detach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Detaching volume 9d09a2fa-f488-4423-83e9-48dd4677280f from instance bac075bb-678c-47e3-9bb3-12d145aa81b4. Jun 23 15:58:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Detach volume completed successfully. Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c0001034-eb8f-4c52-8ea3-561a741279a6 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:02 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a552a738-58fc-448a-8289-568142aef62d" returned: 0 in 0.667s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-a552a738-58fc-448a-8289-568142aef62d" released by "delete_volume" :: held 1.570s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:02 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['a4410461-6d8c-4c08-bb04-2c0f3f5410ed', 'fe00d2a5-867a-4692-94b6-7186f829e185', 'afebd4ee-bc7e-49bd-9320-f9a8df08da8b', '43771c58-f3f5-4f24-a5da-a97dacf2f253'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:03 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:03 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a7a28fdb-375f-4078-a892-e7d0b98a06c4 tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" by "detach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a7a28fdb-375f-4078-a892-e7d0b98a06c4 tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a7a28fdb-375f-4078-a892-e7d0b98a06c4 tempest-VolumesActionsTest-516139392 None] Volume detach called, but volume not attached. Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a7a28fdb-375f-4078-a892-e7d0b98a06c4 tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-935d2e2e-7483-4b07-82e7-6ed5ce904940-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-935d2e2e-7483-4b07-82e7-6ed5ce904940-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b6b3c-cacd-4b83-95f1-c60081b3e06e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:03 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 Jun 23 15:58:03 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:04 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.961s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Deleted volume successfully. Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dd1b3ecc-ffa1-4ddd-8184-c318d0dec9bb tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-a552a738-58fc-448a-8289-568142aef62d-delete_volume" released by "delete_volume" :: held 7.864s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-quobyte-9d09a2fa-f488-4423-83e9-48dd4677280f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "cinder-quobyte-9d09a2fa-f488-4423-83e9-48dd4677280f" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f83eb93-59e1-47a7-bc08-5e2baf742516]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:04 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f Jun 23 15:58:04 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:04 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940" returned: 0 in 1.059s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:04 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940 Jun 23 15:58:04 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:05 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f" returned: 0 in 1.085s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:05 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f Jun 23 15:58:05 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:05 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-935d2e2e-7483-4b07-82e7-6ed5ce904940" returned: 0 in 0.860s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-quobyte-935d2e2e-7483-4b07-82e7-6ed5ce904940" released by "delete_volume" :: held 1.981s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Created reservations ['793b13a8-138a-482b-a7f5-b72de546c8bb', '4e1c19f7-c078-4b5d-bc89-c1ca4347c20c', 'e5afbab7-1ac0-47b7-a301-bcf0dc499001', 'fadb9821-3548-4bd2-99cb-089ab128c4b6'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:05 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:05 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:05 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:05 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9d09a2fa-f488-4423-83e9-48dd4677280f" returned: 0 in 1.372s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:06 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "cinder-quobyte-9d09a2fa-f488-4423-83e9-48dd4677280f" released by "delete_volume" :: held 2.539s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Created reservations ['8b65799d-0cff-4eca-a9b8-697e558443be', '489948fe-e2c1-4d48-9aa4-4d6217609621', 'c4727fa7-d5b0-4244-80e8-ebb6df4566c7', 'caa4721b-80c1-4616-aa14-94b13fb25d95'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:07 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:07 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:07 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.670s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Deleted volume successfully. Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ccba17e3-7af5-42eb-bfd6-5cb52042f35c tempest-VolumesDeleteCascade-1947637600 None] Lock "cinder-935d2e2e-7483-4b07-82e7-6ed5ce904940-delete_volume" released by "delete_volume" :: held 4.025s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:07 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.783s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:58:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:58:08 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.376s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:08 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Deleted volume successfully. Jun 23 15:58:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-dfc3fe41-119d-4a81-8f47-e5771ac2102c tempest-VolumesActionsTest-516139392 None] Lock "cinder-9d09a2fa-f488-4423-83e9-48dd4677280f-delete_volume" released by "delete_volume" :: held 4.332s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-d106c110-16bb-4f12-aa21-61b99b59030a req-b61bae24-f438-4b21-9a9d-d28e646b8fe4 tempest-AttachVolumeTestJSON-1963781098 None] Terminate volume connection completed successfully. Jun 23 15:58:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-d106c110-16bb-4f12-aa21-61b99b59030a req-b61bae24-f438-4b21-9a9d-d28e646b8fe4 tempest-AttachVolumeTestJSON-1963781098 None] Deleting attachment 2467877d-990d-44b0-8750-80b37774f631. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Flow 'volume_create_manager' (91ff3e70-17b7-4332-aa20-4268e1edc0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c378ef5-049e-4089-86f5-ea614b5bc512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c378ef5-049e-4089-86f5-ea614b5bc512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1023221625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5607c6-ba9f-414e-947d-513c0904556a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1938acb59344358c49bf11cbfe9e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:14Z,use_quota=True,user_id='58fd17ce3bc34046a29cece7774c2b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520f9bb5-d5eb-4c17-8080-e974937b9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520f9bb5-d5eb-4c17-8080-e974937b9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f3ab0e-9c4d-4f23-9c1e-5b634fcbf6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f3ab0e-9c4d-4f23-9c1e-5b634fcbf6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5607c6-ba9f-414e-947d-513c0904556a', 'volume_name': 'volume-ef5607c6-ba9f-414e-947d-513c0904556a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52d206b-24e5-4448-a02d-49041d218599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52d206b-24e5-4448-a02d-49041d218599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb9c98-3498-403d-85cd-d6659f988c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Volume ef5607c6-ba9f-414e-947d-513c0904556a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5607c6-ba9f-414e-947d-513c0904556a', 'volume_size': 1} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1023221625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5607c6-ba9f-414e-947d-513c0904556a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1938acb59344358c49bf11cbfe9e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:14Z,use_quota=True,user_id='58fd17ce3bc34046a29cece7774c2b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Creating volume ef5607c6-ba9f-414e-947d-513c0904556a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:13 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:13 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a 1073741824 Jun 23 15:58:13 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:14 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a 1073741824" returned: 0 in 1.015s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:14 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a Jun 23 15:58:14 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:15 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a" returned: 0 in 0.650s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cb9c98-3498-403d-85cd-d6659f988c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5607c6-ba9f-414e-947d-513c0904556a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eaa8426-608f-4bf0-b1dc-b8c1fbd8d8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Volume volume-ef5607c6-ba9f-414e-947d-513c0904556a (ef5607c6-ba9f-414e-947d-513c0904556a): created successfully Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eaa8426-608f-4bf0-b1dc-b8c1fbd8d8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Flow 'volume_create_manager' (91ff3e70-17b7-4332-aa20-4268e1edc0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e055ef05-889e-4afd-b169-7b3a2967ff9d tempest-VolumesTransfersV357Test-938513363 None] Created volume successfully. Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3d4e6f27-d5e0-4dd7-ac8b-a931da212b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf2db73-4757-4951-afcb-41b65d5314eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf2db73-4757-4951-afcb-41b65d5314eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128446040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbf7d3d-a3f0-4433-9289-2d92e7b36f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:16Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0b5c77-d0c8-41ca-a85f-eb78c1a24c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0b5c77-d0c8-41ca-a85f-eb78c1a24c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec5bfc4-547e-4703-b8a3-07d50261498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec5bfc4-547e-4703-b8a3-07d50261498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbf7d3d-a3f0-4433-9289-2d92e7b36f18', 'volume_name': 'volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0a285-fe16-49b6-8545-03447d1b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0a285-fe16-49b6-8545-03447d1b430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c431d75-0022-445f-90fd-7ff3996d7da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:16 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Volume 1fbf7d3d-a3f0-4433-9289-2d92e7b36f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18', 'volume_size': 1} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128446040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbf7d3d-a3f0-4433-9289-2d92e7b36f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:16Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Creating volume 1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:16 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:16 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 1073741824 Jun 23 15:58:16 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7248a3de-8c9a-4851-a0e4-465015275d75 tempest-VolumesTransfersV357Test-1597321847 None] Transfer volume completed successfully. Jun 23 15:58:17 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 1073741824" returned: 0 in 0.889s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:17 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 Jun 23 15:58:17 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "cinder-ef5607c6-ba9f-414e-947d-513c0904556a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-ef5607c6-ba9f-414e-947d-513c0904556a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "cinder-quobyte-ef5607c6-ba9f-414e-947d-513c0904556a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-quobyte-ef5607c6-ba9f-414e-947d-513c0904556a" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f412b0-5f42-4f51-a4dc-04639c7b939e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:17 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" returned: 0 in 0.778s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:17 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:17 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c431d75-0022-445f-90fd-7ff3996d7da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7aa35b3-f407-4a23-845a-ee2c002cdb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:17 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Volume volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 (1fbf7d3d-a3f0-4433-9289-2d92e7b36f18): created successfully Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7aa35b3-f407-4a23-845a-ee2c002cdb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3d4e6f27-d5e0-4dd7-ac8b-a931da212b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7ed9e634-222c-4392-b5a4-3766b326cfb9 tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "cinder-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-quobyte-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a3d92-479c-4154-b485-ab6c0c332bac]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:18 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 Jun 23 15:58:18 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:18 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a" returned: 0 in 0.993s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:18 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a Jun 23 15:58:18 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:19 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" returned: 0 in 1.006s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:19 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18 Jun 23 15:58:19 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:19 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ef5607c6-ba9f-414e-947d-513c0904556a" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-quobyte-ef5607c6-ba9f-414e-947d-513c0904556a" released by "delete_volume" :: held 1.902s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Created reservations ['79efcd25-4f63-4d23-8145-96042b3b1687', 'a67d2eaa-bacf-4df1-9f59-307849059d1e', 'e42db1dd-1135-4dd4-8bed-dccb4112f363', '12f60406-0c9e-4ca9-a836-0f3ee34dae81'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:20 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:20 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:20 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" returned: 0 in 1.105s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18" released by "delete_volume" :: held 2.179s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Flow 'volume_create_manager' (60f22b67-6b2c-4372-a236-cf01a2b511aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a57b80-aa23-4580-be7c-29a565b87088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a57b80-aa23-4580-be7c-29a565b87088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1113501108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1938acb59344358c49bf11cbfe9e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:21Z,use_quota=True,user_id='58fd17ce3bc34046a29cece7774c2b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d618bd7-057e-4da7-a550-718cdb141b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d618bd7-057e-4da7-a550-718cdb141b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabb60dd-c259-4587-9ad7-4cf4d002769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabb60dd-c259-4587-9ad7-4cf4d002769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a', 'volume_name': 'volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33543401-9b85-4eb9-be69-d91684d13d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33543401-9b85-4eb9-be69-d91684d13d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061108e-c6f6-48b7-933f-6b1fd98f4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:20 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Volume df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a', 'volume_size': 1} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1113501108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1938acb59344358c49bf11cbfe9e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:21Z,use_quota=True,user_id='58fd17ce3bc34046a29cece7774c2b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Creating volume df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:20 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:20 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a 1073741824 Jun 23 15:58:20 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Created reservations ['dbd1221a-3da1-49be-8287-67eeae565fd6', '2a7175ed-1c65-4495-b1f2-26b5f195366e', 'a07584bf-be45-4bad-b2c1-27cb667d8251', 'cea4ffcb-818a-4522-9567-31572d5e7f40'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:20 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.963s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Deleted volume successfully. Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3fcac63f-93ff-4ffd-9890-0fca062cb05f tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-ef5607c6-ba9f-414e-947d-513c0904556a-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:20 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:21 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:21 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.761s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:21 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Deleted volume successfully. Jun 23 15:58:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-716a0f03-6923-493e-9b8b-a390a810bb1d tempest-VolumesActionsTest-1875154089 None] Lock "cinder-1fbf7d3d-a3f0-4433-9289-2d92e7b36f18-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:21 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a 1073741824" returned: 0 in 1.039s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:21 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a Jun 23 15:58:21 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (7c0074f4-eca8-4035-aa3c-ff45113e624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958885a9-2150-4142-b4b6-31d94721fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958885a9-2150-4142-b4b6-31d94721fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981322613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b4db39-4b27-4328-b8b1-bf3e3e40be52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:22Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2a4e8b-1680-435a-b8a4-5a10b2607377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2a4e8b-1680-435a-b8a4-5a10b2607377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00328e32-cdea-4618-ab09-ab10671b62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00328e32-cdea-4618-ab09-ab10671b62cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b4db39-4b27-4328-b8b1-bf3e3e40be52', 'volume_name': 'volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e7e023-2055-484d-9a54-339f39e43945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e7e023-2055-484d-9a54-339f39e43945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f963a125-7ccb-4452-8b9b-788c3a30e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Volume b7b4db39-4b27-4328-b8b1-bf3e3e40be52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52', 'volume_size': 1} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:22 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" returned: 0 in 0.752s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981322613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b4db39-4b27-4328-b8b1-bf3e3e40be52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:22Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Creating volume b7b4db39-4b27-4328-b8b1-bf3e3e40be52 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:22 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 1073741824 Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8061108e-c6f6-48b7-933f-6b1fd98f4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e894b3b-f463-4aff-9b16-1010f528e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:22 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Volume volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a (df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a): created successfully Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e894b3b-f463-4aff-9b16-1010f528e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Flow 'volume_create_manager' (60f22b67-6b2c-4372-a236-cf01a2b511aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a6d5a4cd-954e-464a-8971-2d223cd63883 tempest-VolumesTransfersV357Test-938513363 None] Created volume successfully. Jun 23 15:58:23 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 1073741824" returned: 0 in 1.233s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:24 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 Jun 23 15:58:24 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "cinder-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "cinder-quobyte-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-quobyte-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ed133-d440-46b6-8c94-febc4e70c8b5]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:25 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a Jun 23 15:58:25 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:25 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" returned: 0 in 1.165s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.473s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f963a125-7ccb-4452-8b9b-788c3a30e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499b491c-6ec8-4f70-985b-43ea19676ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:25 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Volume volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 (b7b4db39-4b27-4328-b8b1-bf3e3e40be52): created successfully Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499b491c-6ec8-4f70-985b-43ea19676ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (7c0074f4-eca8-4035-aa3c-ff45113e624e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:25 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c3b2cfa4-a8c7-4054-bb96-d89e6864a3a5 tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:26 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" returned: 0 in 1.214s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:26 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a Jun 23 15:58:26 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-b7b4db39-4b27-4328-b8b1-bf3e3e40be52-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-b7b4db39-4b27-4328-b8b1-bf3e3e40be52-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-quobyte-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[02105d8d-e404-44d8-93e4-76dc5a00dc0a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:26 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 Jun 23 15:58:26 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:27 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" returned: 0 in 1.708s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-quobyte-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a" released by "delete_volume" :: held 2.996s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:27 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Created reservations ['8b8e058b-d5a4-4e19-b820-3033692a1301', '5b69d83a-2e15-4f79-8ea9-d3cbc08c05b0', 'b28f1478-7213-4a18-9b8f-e8291c6bdb78', 'e3c3959f-c059-4683-a195-81e418cc394f'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:28 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:28 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:28 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" returned: 0 in 2.166s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:28 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52 Jun 23 15:58:28 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:29 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.504s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:29 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Deleted volume successfully. Jun 23 15:58:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-13ecfa63-260c-487a-be3e-bde059cf87cd tempest-VolumesTransfersV357Test-1525553223 None] Lock "cinder-df2064b3-5c15-43f5-9bf2-3e9d2a4f3e8a-delete_volume" released by "delete_volume" :: held 4.965s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:30 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" returned: 0 in 1.313s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-b7b4db39-4b27-4328-b8b1-bf3e3e40be52" released by "delete_volume" :: held 3.611s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Created reservations ['a6f7beaf-018e-4a33-828e-023113f95f9d', '02453272-a311-44da-ac91-5c9bae440c8e', '325aeaa3-54d4-439d-9301-71836025f610', '1a6de975-a109-4f4c-97f0-8e207b0ecbd3'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:30 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:30 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:31 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.114s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:31 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Deleted volume successfully. Jun 23 15:58:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-900da74f-f94d-4f76-887c-81566afe9d65 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-b7b4db39-4b27-4328-b8b1-bf3e3e40be52-delete_volume" released by "delete_volume" :: held 5.189s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3e38c21f-a646-4fad-8c89-da84a581c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde7362d-9103-4bf1-af72-cc1f9972dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde7362d-9103-4bf1-af72-cc1f9972dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1286105991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdbb34c-a563-4091-912d-257c88fe37c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:32Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68c0d88-8889-4bd7-8453-d776aff08e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68c0d88-8889-4bd7-8453-d776aff08e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53631860-7698-420b-886c-099d075f9861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53631860-7698-420b-886c-099d075f9861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdbb34c-a563-4091-912d-257c88fe37c9', 'volume_name': 'volume-7fdbb34c-a563-4091-912d-257c88fe37c9', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7d88d8-4f16-4aeb-b47d-81ff2eb718b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7d88d8-4f16-4aeb-b47d-81ff2eb718b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2588e9d0-0114-4501-b491-1f00c30e5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:32 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Volume 7fdbb34c-a563-4091-912d-257c88fe37c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdbb34c-a563-4091-912d-257c88fe37c9', 'volume_size': 1} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1286105991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdbb34c-a563-4091-912d-257c88fe37c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:32Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Creating volume 7fdbb34c-a563-4091-912d-257c88fe37c9 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:32 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:32 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 1073741824 Jun 23 15:58:32 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:34 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 1073741824" returned: 0 in 1.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:34 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 Jun 23 15:58:34 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:35 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9" returned: 0 in 1.277s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] <== create_volume: return (3135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.142s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2588e9d0-0114-4501-b491-1f00c30e5b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdbb34c-a563-4091-912d-257c88fe37c9', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1f2f4-ed94-4f69-af27-a9c9c3e5c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:35 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Volume volume-7fdbb34c-a563-4091-912d-257c88fe37c9 (7fdbb34c-a563-4091-912d-257c88fe37c9): created successfully Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1f2f4-ed94-4f69-af27-a9c9c3e5c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (3e38c21f-a646-4fad-8c89-da84a581c405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f1a0100f-6059-48b3-8585-1f15d03cf846 tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-7fdbb34c-a563-4091-912d-257c88fe37c9-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-7fdbb34c-a563-4091-912d-257c88fe37c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-quobyte-7fdbb34c-a563-4091-912d-257c88fe37c9" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-7fdbb34c-a563-4091-912d-257c88fe37c9" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fc34d-ecaf-4542-accd-31bcfb1a10f0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:37 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 Jun 23 15:58:37 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:38 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9" returned: 0 in 1.348s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:38 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9 Jun 23 15:58:38 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Flow 'volume_create_manager' (f43ed530-84cd-46c3-9fd9-5d62e1d0179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1575a4d-e6fb-4a28-bb30-8118f0e49d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1575a4d-e6fb-4a28-bb30-8118f0e49d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-523176494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc92024-5a29-497d-93dc-55d82d6a49e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461f94dded3f4b11bfd9d32d618bb280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:39Z,use_quota=True,user_id='f7f85613be424f3592860935ea75e945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cceb45e-1c6a-4df6-a80a-bb88d80d6615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cceb45e-1c6a-4df6-a80a-bb88d80d6615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1b1cd1-24a8-4c57-9e4c-82a51a6e7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1b1cd1-24a8-4c57-9e4c-82a51a6e7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc92024-5a29-497d-93dc-55d82d6a49e9', 'volume_name': 'volume-fcc92024-5a29-497d-93dc-55d82d6a49e9', 'volume_size': 2}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd7879f-96a3-4ecd-9e97-74b66767146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd7879f-96a3-4ecd-9e97-74b66767146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8023f0dd-98f4-4e55-a740-a41717537a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:38 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Volume fcc92024-5a29-497d-93dc-55d82d6a49e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc92024-5a29-497d-93dc-55d82d6a49e9', 'volume_size': 2} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-523176494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc92024-5a29-497d-93dc-55d82d6a49e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461f94dded3f4b11bfd9d32d618bb280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:39Z,use_quota=True,user_id='f7f85613be424f3592860935ea75e945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Creating volume fcc92024-5a29-497d-93dc-55d82d6a49e9 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:38 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 2147483648 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:38 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 2147483648 Jun 23 15:58:38 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:39 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7fdbb34c-a563-4091-912d-257c88fe37c9" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-7fdbb34c-a563-4091-912d-257c88fe37c9" released by "delete_volume" :: held 2.242s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=73,cinder:UPDATE=92,cinder:INSERT=17,cinder:DELETE=4 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Created reservations ['09d70502-e067-41c9-aafb-b6ff1773183c', '991057df-ed70-4bd4-95aa-c08ec5e24535', '018a3317-c383-4e76-ad2d-a9622d2418ac', 'de5c8934-f5d6-4d02-a43c-90988033fcb8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:39 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:39 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:40 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 2147483648" returned: 0 in 1.154s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:40 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 Jun 23 15:58:40 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:40 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.681s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Deleted volume successfully. Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9d85599f-f286-4e6c-a28d-75c7fec5c050 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-7fdbb34c-a563-4091-912d-257c88fe37c9-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:40 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9" returned: 0 in 0.739s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8023f0dd-98f4-4e55-a740-a41717537a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc92024-5a29-497d-93dc-55d82d6a49e9', 'volume_size': 2}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ca890b-475b-4efc-8262-5b9304f58281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Volume volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 (fcc92024-5a29-497d-93dc-55d82d6a49e9): created successfully Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ca890b-475b-4efc-8262-5b9304f58281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Flow 'volume_create_manager' (f43ed530-84cd-46c3-9fd9-5d62e1d0179f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2390ccce-91a2-4a8a-a532-eef81a5c9857 tempest-VolumesCloneNegativeTest-1607383227 None] Created volume successfully. Jun 23 15:58:40 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=69,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=28 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (69a1799a-7d64-46a3-b8a0-ffddb2792442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db425b82-ff9c-479a-b6b9-ed2b9d296311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db425b82-ff9c-479a-b6b9-ed2b9d296311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451150945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d447ff-7ed9-452f-8c4d-6cf40c4982d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:41Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38418f6-ae7d-4e69-960a-b10e0c29ba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38418f6-ae7d-4e69-960a-b10e0c29ba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1973e0-8f3f-4801-ac5c-8ebc65987a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1973e0-8f3f-4801-ac5c-8ebc65987a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d447ff-7ed9-452f-8c4d-6cf40c4982d8', 'volume_name': 'volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5802b5-e1a3-46f3-9eb8-62a53c2e0f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5802b5-e1a3-46f3-9eb8-62a53c2e0f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82bfe20-53d7-4e7f-909b-a2cf680f23ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Volume 83d447ff-7ed9-452f-8c4d-6cf40c4982d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8', 'volume_size': 1} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451150945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d447ff-7ed9-452f-8c4d-6cf40c4982d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:41Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Creating volume 83d447ff-7ed9-452f-8c4d-6cf40c4982d8 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:41 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 1073741824 Jun 23 15:58:41 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Acquiring lock "cinder-fcc92024-5a29-497d-93dc-55d82d6a49e9-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:42 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "cinder-fcc92024-5a29-497d-93dc-55d82d6a49e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 1073741824" returned: 0 in 0.981s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Acquiring lock "cinder-quobyte-fcc92024-5a29-497d-93dc-55d82d6a49e9" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:42 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 Jun 23 15:58:42 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "cinder-quobyte-fcc92024-5a29-497d-93dc-55d82d6a49e9" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966cfe9-ba90-4339-8a15-2dacebadc2f6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:42 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 Jun 23 15:58:42 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:42 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" returned: 0 in 0.657s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82bfe20-53d7-4e7f-909b-a2cf680f23ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76081877-cb3d-452e-9cc0-d885ef90680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Volume volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 (83d447ff-7ed9-452f-8c4d-6cf40c4982d8): created successfully Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76081877-cb3d-452e-9cc0-d885ef90680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (69a1799a-7d64-46a3-b8a0-ffddb2792442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d311867e-3bab-4c23-8d94-c9d4817624ae tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:43 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9" returned: 0 in 0.808s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:43 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9 Jun 23 15:58:43 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-83d447ff-7ed9-452f-8c4d-6cf40c4982d8-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-83d447ff-7ed9-452f-8c4d-6cf40c4982d8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "cinder-quobyte-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbea8f6-a3f1-4c49-b33a-e8428b2ddaf3]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:43 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 Jun 23 15:58:43 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:43 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fcc92024-5a29-497d-93dc-55d82d6a49e9" returned: 0 in 0.658s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "cinder-quobyte-fcc92024-5a29-497d-93dc-55d82d6a49e9" released by "delete_volume" :: held 1.520s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Created reservations ['41d96480-6c4a-4beb-80cc-d4da7e06ede6', '99e97ee9-cb29-41f4-89e8-fe73efe698a3', '73583203-2ea9-4e73-b939-4f097a9d1e3d', 'ad7c289e-86c3-4d6c-9dc5-8383834f5360'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:43 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:43 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:44 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" returned: 0 in 0.909s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:44 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8 Jun 23 15:58:44 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:44 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.682s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:44 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Deleted volume successfully. Jun 23 15:58:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d220f55f-af49-4adb-b3e7-a61f0ea921bf tempest-VolumesCloneNegativeTest-1607383227 None] Lock "cinder-fcc92024-5a29-497d-93dc-55d82d6a49e9-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" returned: 0 in 0.716s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:45 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-quobyte-83d447ff-7ed9-452f-8c4d-6cf40c4982d8" released by "delete_volume" :: held 1.679s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Created reservations ['c675d4fc-1364-4e08-b3fc-21fabce4bbfb', 'bcc72351-7adf-4ea2-8367-8d98227ae04c', '430f2a1c-26a7-41dc-91bc-8f7c576de759', 'ac14fc56-4ba1-4082-8ade-79e15ee6b019'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:45 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:45 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:45 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.799s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:45 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:46 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Deleted volume successfully. Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d143c99-ef63-4c8c-a51c-ea5b5c2e93e7 tempest-VolumesActionsTest-1875154089 None] Lock "cinder-83d447ff-7ed9-452f-8c4d-6cf40c4982d8-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (77a2c2b3-ca56-453d-a0de-d5477e3020d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13699227-8fdf-41a0-be90-c724b1aa03a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13699227-8fdf-41a0-be90-c724b1aa03a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620078107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0008fffe-20ad-427e-b6b8-7a2ab23234e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:46Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dbb42c-f819-46cb-b17b-b2540c1db744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dbb42c-f819-46cb-b17b-b2540c1db744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26205a32-3820-4d80-aba8-8206ebc6146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26205a32-3820-4d80-aba8-8206ebc6146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0008fffe-20ad-427e-b6b8-7a2ab23234e4', 'volume_name': 'volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dead8d0f-f357-4617-aa97-c104f3f6b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dead8d0f-f357-4617-aa97-c104f3f6b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69238b7d-460a-4c27-8a7a-7fe2d4037251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:46 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Volume 0008fffe-20ad-427e-b6b8-7a2ab23234e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4', 'volume_size': 1} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620078107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0008fffe-20ad-427e-b6b8-7a2ab23234e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420556d278d4ba187f69414dff12902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:46Z,use_quota=True,user_id='5d4fe29d18fa48f6b1c0444c21198f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Creating volume 0008fffe-20ad-427e-b6b8-7a2ab23234e4 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:46 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:46 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 1073741824 Jun 23 15:58:46 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:47 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 1073741824" returned: 0 in 0.917s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:47 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 Jun 23 15:58:47 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (1cf708d7-ad1d-4d09-b06f-8e0b624f0c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ede6874-d628-46f1-b789-018993f889a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ede6874-d628-46f1-b789-018993f889a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457141484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ffcf2-d959-4758-a9dd-80cb9d996584,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:48Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5b9aa-cca2-4646-a985-b86f2bfe629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5b9aa-cca2-4646-a985-b86f2bfe629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7abcce8-c199-4820-8eb7-cb61bed44468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7abcce8-c199-4820-8eb7-cb61bed44468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14ffcf2-d959-4758-a9dd-80cb9d996584', 'volume_name': 'volume-f14ffcf2-d959-4758-a9dd-80cb9d996584', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ed21e4-d213-45c7-a41d-ef2a85e73b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ed21e4-d213-45c7-a41d-ef2a85e73b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be584693-469f-4fc7-b32e-0a1ef09cd300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:47 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Volume f14ffcf2-d959-4758-a9dd-80cb9d996584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14ffcf2-d959-4758-a9dd-80cb9d996584', 'volume_size': 1} Jun 23 15:58:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:48 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4" returned: 0 in 0.670s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457141484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ffcf2-d959-4758-a9dd-80cb9d996584,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:48Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Creating volume f14ffcf2-d959-4758-a9dd-80cb9d996584 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:48 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:48 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 1073741824 Jun 23 15:58:48 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69238b7d-460a-4c27-8a7a-7fe2d4037251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754abbf3-bc44-48f6-97ba-76180130e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Volume volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 (0008fffe-20ad-427e-b6b8-7a2ab23234e4): created successfully Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754abbf3-bc44-48f6-97ba-76180130e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Flow 'volume_create_manager' (77a2c2b3-ca56-453d-a0de-d5477e3020d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-55c08a7d-bc88-4084-96d2-e4e3f8e03362 tempest-VolumesActionsTest-516139392 None] Created volume successfully. Jun 23 15:58:48 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 1073741824" returned: 0 in 0.917s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:49 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 Jun 23 15:58:49 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-0008fffe-20ad-427e-b6b8-7a2ab23234e4-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "cinder-0008fffe-20ad-427e-b6b8-7a2ab23234e4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Acquiring lock "cinder-quobyte-0008fffe-20ad-427e-b6b8-7a2ab23234e4" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "cinder-quobyte-0008fffe-20ad-427e-b6b8-7a2ab23234e4" acquired by "delete_volume" :: waited 0.014s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3273ef97-0c46-4984-8823-eac252dd2ffb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:49 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 Jun 23 15:58:49 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:49 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584" returned: 0 in 0.803s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be584693-469f-4fc7-b32e-0a1ef09cd300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14ffcf2-d959-4758-a9dd-80cb9d996584', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8301e67-6ed2-4f57-b648-7a1fa923987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Volume volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 (f14ffcf2-d959-4758-a9dd-80cb9d996584): created successfully Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8301e67-6ed2-4f57-b648-7a1fa923987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (1cf708d7-ad1d-4d09-b06f-8e0b624f0c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c6302007-6448-43bd-9108-6a9d51f962e6 tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 15:58:50 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4" returned: 0 in 1.351s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:50 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4 Jun 23 15:58:50 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (36d86aa5-7a61-4c65-8b12-f068326e50dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ffb072-8697-4f2d-ae4f-c3061a9689f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ffb072-8697-4f2d-ae4f-c3061a9689f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11857400',display_name='tempest-VolumesGetTest-Volume-572954990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:51Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25989503-65b4-4029-819a-b9d23c1e59bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25989503-65b4-4029-819a-b9d23c1e59bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f38379-20aa-45be-b3fd-a60976e2811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f38379-20aa-45be-b3fd-a60976e2811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5', 'volume_name': 'volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:51 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9443f4f-8e51-4ba5-ba55-1778847d8d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9443f4f-8e51-4ba5-ba55-1778847d8d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebe5917-5f04-4ff2-a1ab-1eec4823b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:51 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Volume a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5', 'volume_size': 1} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11857400',display_name='tempest-VolumesGetTest-Volume-572954990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:51Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Creating volume a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:51 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0008fffe-20ad-427e-b6b8-7a2ab23234e4" returned: 0 in 0.966s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:51 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 1073741824 Jun 23 15:58:51 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "cinder-quobyte-0008fffe-20ad-427e-b6b8-7a2ab23234e4" released by "delete_volume" :: held 2.381s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Created reservations ['2da2d275-3c27-4cbc-8d0f-4ca42a2d9602', '2766b812-e07d-417d-a17b-f1533e8925c4', 'c07cf68a-f449-424c-90dc-e1b68feeaf42', '33351fcc-36d9-4d10-9562-c4eae2056404'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:51 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:51 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:52 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.763s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:52 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:52 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Deleted volume successfully. Jun 23 15:58:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48f0b0f8-fd5d-41f5-aa5f-dc2a4d4300d9 tempest-VolumesActionsTest-516139392 None] Lock "cinder-0008fffe-20ad-427e-b6b8-7a2ab23234e4-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:52 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 1073741824" returned: 0 in 1.024s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:52 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 Jun 23 15:58:52 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:53 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" returned: 0 in 0.737s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebe5917-5f04-4ff2-a1ab-1eec4823b679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cd4ee2-0830-472c-b045-e0e45689463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Volume volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 (a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5): created successfully Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cd4ee2-0830-472c-b045-e0e45689463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (36d86aa5-7a61-4c65-8b12-f068326e50dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-27ac6f0d-9a5c-4222-ab36-b58cf6afb8f6 tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (39e5071a-4725-4b6c-bad0-02860a1a8ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f262bed-ea4c-4d65-b11a-14bfb3c861a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f262bed-ea4c-4d65-b11a-14bfb3c861a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1668784072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f29853-c837-43bc-b334-fd26e0a0841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:54Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5de13c-635a-4dd8-a7e8-f1e92f5a6a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5de13c-635a-4dd8-a7e8-f1e92f5a6a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be52c95-7c20-4bd6-ac98-8d973a4dd78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be52c95-7c20-4bd6-ac98-8d973a4dd78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f29853-c837-43bc-b334-fd26e0a0841d', 'volume_name': 'volume-96f29853-c837-43bc-b334-fd26e0a0841d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c08c935-775e-4d9c-920b-3c1a7f7893cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c08c935-775e-4d9c-920b-3c1a7f7893cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c3e69b-7586-4f7f-a92e-13f8d21e6ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:54 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Volume 96f29853-c837-43bc-b334-fd26e0a0841d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f29853-c837-43bc-b334-fd26e0a0841d', 'volume_size': 1} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1668784072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f29853-c837-43bc-b334-fd26e0a0841d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:58:54Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Creating volume 96f29853-c837-43bc-b334-fd26e0a0841d {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:58:54 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:54 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d 1073741824 Jun 23 15:58:54 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "cinder-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a29ccf-fd2f-4927-be53-0ba4afa52681]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:54 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 Jun 23 15:58:54 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:55 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d 1073741824" returned: 0 in 1.003s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:55 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d Jun 23 15:58:55 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" returned: 0 in 1.014s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:55 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:55 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5 Jun 23 15:58:55 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:56 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d" returned: 0 in 0.948s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c3e69b-7586-4f7f-a92e-13f8d21e6ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f29853-c837-43bc-b334-fd26e0a0841d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da84103d-997c-4c98-96bd-4b3af8b5c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:58:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Volume volume-96f29853-c837-43bc-b334-fd26e0a0841d (96f29853-c837-43bc-b334-fd26e0a0841d): created successfully Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da84103d-997c-4c98-96bd-4b3af8b5c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (39e5071a-4725-4b6c-bad0-02860a1a8ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:58:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4e320ca3-8c9c-42d6-87e5-592a36f6d506 tempest-AttachVolumeNegativeTest-343860166 None] Created volume successfully. Jun 23 15:58:56 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" returned: 0 in 0.788s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5" released by "delete_volume" :: held 1.848s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Created reservations ['f9eb83dc-cf41-4d3c-99f4-c0e1f7206f22', 'e786f5fe-956b-4d06-8027-69f49026f719', '3d66c1b5-eedc-444a-8651-ac97ca362ba1', '760ab004-94a8-41c0-b639-60baa4fc833d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:56 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:56 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-f14ffcf2-d959-4758-a9dd-80cb9d996584-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "cinder-f14ffcf2-d959-4758-a9dd-80cb9d996584-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-f14ffcf2-d959-4758-a9dd-80cb9d996584" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-f14ffcf2-d959-4758-a9dd-80cb9d996584" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2a531-9f7e-4597-be15-0ac4c23e7bc1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:57 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 Jun 23 15:58:57 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:57 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.013s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:58:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 15:58:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6f92cafe-57c8-4211-a918-935ea4253b75 tempest-VolumesGetTest-1789803864 None] Lock "cinder-a8ea76cd-7d46-48fc-bb44-3ae4ad8e07d5-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:58 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584" returned: 0 in 0.977s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:58 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584 Jun 23 15:58:58 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:58:59 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f14ffcf2-d959-4758-a9dd-80cb9d996584" returned: 0 in 0.801s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-f14ffcf2-d959-4758-a9dd-80cb9d996584" released by "delete_volume" :: held 1.852s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Created reservations ['f0a984b1-aa61-4b3d-a28a-b99e90fae986', '093159df-2bbb-470f-bd83-22617665e1f6', '60bb47a7-2ac8-4223-83d9-fd57639b288b', '16f946a5-7cbe-41cc-9e48-c5754530f6fc'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:58:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:58:59 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:58:59 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (878a3c8e-2400-4286-89cf-8cc2dd3f0922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a307073a-eaed-421a-90af-9db6a2477d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a307073a-eaed-421a-90af-9db6a2477d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1878794424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31480fcc-abc0-479f-85dd-cb4094897455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:00Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb4252e-43a0-4f62-816e-a976324b2fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb4252e-43a0-4f62-816e-a976324b2fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4328eadb-b1ab-49b0-931e-90ab5cde3ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4328eadb-b1ab-49b0-931e-90ab5cde3ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31480fcc-abc0-479f-85dd-cb4094897455', 'volume_name': 'volume-31480fcc-abc0-479f-85dd-cb4094897455', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7878d6-bf43-4915-b949-7c5f4717c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:00 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7878d6-bf43-4915-b949-7c5f4717c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54f149b-6aef-4db9-b6df-8708c6ce77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Volume 31480fcc-abc0-479f-85dd-cb4094897455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31480fcc-abc0-479f-85dd-cb4094897455', 'volume_size': 1} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1878794424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31480fcc-abc0-479f-85dd-cb4094897455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:00Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Creating volume 31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:59:00 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.081s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 15:59:00 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 1073741824 Jun 23 15:59:00 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e9f0de0-26b4-46f8-bde8-bff968662481 tempest-VolumesGetTest-1789803864 None] Lock "cinder-f14ffcf2-d959-4758-a9dd-80cb9d996584-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:01 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 1073741824" returned: 0 in 1.313s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:01 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:01 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:02 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 0.693s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.587s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54f149b-6aef-4db9-b6df-8708c6ce77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31480fcc-abc0-479f-85dd-cb4094897455', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e3ca90-7599-4637-afa5-31ab77839e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c00ea0-cf8e-4906-96ea-a2266c659c2f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Volume volume-31480fcc-abc0-479f-85dd-cb4094897455 (31480fcc-abc0-479f-85dd-cb4094897455): created successfully Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e3ca90-7599-4637-afa5-31ab77839e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (878a3c8e-2400-4286-89cf-8cc2dd3f0922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b3fc565e-ce74-4e34-b966-0e802451b7d0 tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 15:59:02 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d Jun 23 15:59:02 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d" returned: 0 in 0.853s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:03 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.880s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-96f29853-c837-43bc-b334-fd26e0a0841d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2701fc7-1558-4224-acb6-7d4e26cdb14d', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:59:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-2ce4e5bf-2296-4ff3-acbe-285c1c543f28 req-aed6fb3b-8a11-4d25-8bda-b834a493f464 tempest-AttachVolumeNegativeTest-343860166 None] attachment_update completed successfully. Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (53e386de-86cf-47db-8a3c-d4f5c95f143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb7cfcb-33ad-4283-84ff-c914d7326c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb7cfcb-33ad-4283-84ff-c914d7326c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134967327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f75ea1-255c-455a-8c21-9e277a3baa08,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=31480fcc-abc0-479f-85dd-cb4094897455,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:04Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237cb1c8-5054-4a3c-9ae4-56ddd75a7ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237cb1c8-5054-4a3c-9ae4-56ddd75a7ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb220f4b-30d6-433b-99c0-70927a8c1354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb220f4b-30d6-433b-99c0-70927a8c1354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '09f75ea1-255c-455a-8c21-9e277a3baa08', 'volume_name': 'volume-09f75ea1-255c-455a-8c21-9e277a3baa08', 'volume_size': 1, 'source_volid': '31480fcc-abc0-479f-85dd-cb4094897455', 'source_volstatus': 'available'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e134ab-3ab1-4efb-9c69-158079a58a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e134ab-3ab1-4efb-9c69-158079a58a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d56fb0-7084-4dc3-b0fd-43e299a8da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Volume 09f75ea1-255c-455a-8c21-9e277a3baa08: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-09f75ea1-255c-455a-8c21-9e277a3baa08', 'volume_size': 1, 'source_volid': '31480fcc-abc0-479f-85dd-cb4094897455', 'source_volstatus': 'available'} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:04 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Cloning volume 31480fcc-abc0-479f-85dd-cb4094897455 to volume 09f75ea1-255c-455a-8c21-9e277a3baa08 Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Creating offline snapshot 3c9dc3cc-fe36-4482-ab38-1b44376e8ecd of volume 31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc1c54-3eb0-48f4-b88d-7f3017011c58]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:04 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:04 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:05 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 0.873s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:05 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd 1G Jun 23 15:59:05 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:05 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:05 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:06 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd 1G" returned: 0 in 0.985s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31480fcc-abc0-479f-85dd-cb4094897455 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:06 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31480fcc-abc0-479f-85dd-cb4094897455 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:06 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:06 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.863s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 15:59:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 15:59:07 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31480fcc-abc0-479f-85dd-cb4094897455 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 0.874s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:07 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd is being set with open permissions: ugo+rw Jun 23 15:59:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:07 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:07 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:08 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 1.009s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:08 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info Jun 23 15:59:08 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info" returned: 0 in 0.998s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:09 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info is being set with open permissions: ugo+rw Jun 23 15:59:09 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:09 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info Jun 23 15:59:09 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Flow 'volume_create_manager' (a681f317-b031-4806-8806-5364d95a2ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81cfe0c-bacb-4678-be95-2cea34bbb139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81cfe0c-bacb-4678-be95-2cea34bbb139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-113094569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e81bec2-2214-4dd9-a984-84d032c0fba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9729329f5a6341af9e82e3c51e7cb319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:09Z,use_quota=True,user_id='bf2989e9513f4501a0a9872251531d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47f08f-0c89-46fa-849f-2036d32be6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47f08f-0c89-46fa-849f-2036d32be6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c54798-2083-4298-a5a8-a2255595dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c54798-2083-4298-a5a8-a2255595dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e81bec2-2214-4dd9-a984-84d032c0fba2', 'volume_name': 'volume-5e81bec2-2214-4dd9-a984-84d032c0fba2', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308751b1-02d2-4035-831b-db0fdb14ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308751b1-02d2-4035-831b-db0fdb14ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4544771-e60e-4c11-9732-652b25018858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Volume 5e81bec2-2214-4dd9-a984-84d032c0fba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e81bec2-2214-4dd9-a984-84d032c0fba2', 'volume_size': 1} Jun 23 15:59:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:10 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.info" returned: 0 in 0.847s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] snapshot: 3c9dc3cc-fe36-4482-ab38-1b44376e8ecd, volume: 09f75ea1-255c-455a-8c21-9e277a3baa08, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa177efd-92f6-4856-81b3-63ed8ad11059]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:10 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:10 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-611d4a7b-c2a8-44e5-bb60-9d80c202eba7 req-1b5d3ee4-0807-4eac-8505-a099ac7ff440 tempest-AttachVolumeNegativeTest-343860166 None] Terminate volume connection completed successfully. Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-611d4a7b-c2a8-44e5-bb60-9d80c202eba7 req-1b5d3ee4-0807-4eac-8505-a099ac7ff440 tempest-AttachVolumeNegativeTest-343860166 None] Deleting attachment e2701fc7-1558-4224-acb6-7d4e26cdb14d. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 15:59:10 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31480fcc-abc0-479f-85dd-cb4094897455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6df443-947a-4244-a375-cbde5f61dea2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:11 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:11 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:11 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 0.802s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:11 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 15:59:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:11 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 Jun 23 15:59:11 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:19 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08" returned: 0 in 7.463s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4495a2b-98af-424f-8007-0c718c22b14e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:19 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:19 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:20 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 1.235s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:20 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:59:20 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Converted 1024.00 MB image at 137.14 MB/s Jun 23 15:59:20 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 is being set with open permissions: ugo+rw Jun 23 15:59:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:20 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 Jun 23 15:59:20 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:20 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=43,cinder:UPDATE=64,cinder:DELETE=5,cinder:INSERT=13 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:59:20 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=68,cinder:SELECT=56,cinder:DELETE=8,cinder:INSERT=15 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 15:59:21 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08" returned: 0 in 0.787s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" released by "_copy_volume_from_snapshot" :: held 11.252s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Deleting offline snapshot 3c9dc3cc-fe36-4482-ab38-1b44376e8ecd of volume 31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] snapshot_file for this snap is: volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[28630835-aa91-48ca-a294-33fe2b6649be]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:21 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:21 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:22 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 1.023s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31480fcc-abc0-479f-85dd-cb4094897455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:59:22 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a41420c-f2ab-4a3a-9a09-ed52e47dd3c0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:22 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:22 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:23 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 1.071s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:23 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:23 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:24 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 0.976s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:24 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd Jun 23 15:59:24 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:25 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455.3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" returned: 0 in 0.845s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-3c9dc3cc-fe36-4482-ab38-1b44376e8ecd" released by "_delete_snapshot" :: held 4.076s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.167s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.048s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-113094569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e81bec2-2214-4dd9-a984-84d032c0fba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9729329f5a6341af9e82e3c51e7cb319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:09Z,use_quota=True,user_id='bf2989e9513f4501a0a9872251531d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Creating volume 5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:59:25 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:25 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 1073741824 Jun 23 15:59:25 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d56fb0-7084-4dc3-b0fd-43e299a8da3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f75ea1-255c-455a-8c21-9e277a3baa08', 'volume_size': 1, 'source_volid': '31480fcc-abc0-479f-85dd-cb4094897455', 'source_volstatus': 'available'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223495e-8374-4fe8-b262-e331586c05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:25 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Volume volume-09f75ea1-255c-455a-8c21-9e277a3baa08 (09f75ea1-255c-455a-8c21-9e277a3baa08): created successfully Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223495e-8374-4fe8-b262-e331586c05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (53e386de-86cf-47db-8a3c-d4f5c95f143f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:25 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3aaa823a-9244-4007-bca6-6a4f788da083 tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 15:59:26 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 1073741824" returned: 0 in 1.128s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:26 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:26 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:27 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 0.874s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4544771-e60e-4c11-9732-652b25018858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e81bec2-2214-4dd9-a984-84d032c0fba2', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fa4e68-dff3-4a52-b561-c6c549e2be3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (75b39eca-d975-46c2-869b-eb57d2461eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46667e09-9737-4bff-8a8e-c3474edf0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Volume volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 (5e81bec2-2214-4dd9-a984-84d032c0fba2): created successfully Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fa4e68-dff3-4a52-b561-c6c549e2be3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Flow 'volume_create_manager' (a681f317-b031-4806-8806-5364d95a2ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46667e09-9737-4bff-8a8e-c3474edf0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-543319620',display_name='tempest-VolumesGetTest-Volume-529925163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979cd319-b302-45e0-9866-c4783fa8172d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:28Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c4f3c1-9170-47b8-81ee-10c69bc40e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c4f3c1-9170-47b8-81ee-10c69bc40e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2eabc2f-d532-4fef-8276-d98823b46c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2eabc2f-d532-4fef-8276-d98823b46c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979cd319-b302-45e0-9866-c4783fa8172d', 'volume_name': 'volume-979cd319-b302-45e0-9866-c4783fa8172d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2935daf-77df-4cd2-bc8c-d6e179600575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2935daf-77df-4cd2-bc8c-d6e179600575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f6c439-c663-4be0-a793-e6919217b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:27 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Volume 979cd319-b302-45e0-9866-c4783fa8172d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979cd319-b302-45e0-9866-c4783fa8172d', 'volume_size': 1} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-543319620',display_name='tempest-VolumesGetTest-Volume-529925163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979cd319-b302-45e0-9866-c4783fa8172d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:28Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Creating volume 979cd319-b302-45e0-9866-c4783fa8172d {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:59:27 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:59:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a4101f1a-f6e9-40b3-80ed-f80cf914425a tempest-VolumesCloneTest-1946118279 None] Created volume successfully. Jun 23 15:59:27 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d 1073741824 Jun 23 15:59:27 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:28 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d 1073741824" returned: 0 in 0.975s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:28 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d Jun 23 15:59:28 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Flow 'volume_create_manager' (b4c15800-beb2-4aec-9ca8-325aaa663efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc18d427-5d78-4ca3-bb47-d99ae2d65777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc18d427-5d78-4ca3-bb47-d99ae2d65777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1481221896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9729329f5a6341af9e82e3c51e7cb319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5e81bec2-2214-4dd9-a984-84d032c0fba2,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:29Z,use_quota=True,user_id='bf2989e9513f4501a0a9872251531d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6558eafa-4ba3-4532-9cf5-2daf4112e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6558eafa-4ba3-4532-9cf5-2daf4112e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad126911-2909-454f-9d95-ca2ef8b0c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad126911-2909-454f-9d95-ca2ef8b0c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e', 'volume_name': 'volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e', 'volume_size': 2, 'source_volid': '5e81bec2-2214-4dd9-a984-84d032c0fba2', 'source_volstatus': 'available'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252ee258-8673-4829-86a3-d1b180dd93c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252ee258-8673-4829-86a3-d1b180dd93c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1528470e-8b49-4a13-b28d-c722b2691b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Volume f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e', 'volume_size': 2, 'source_volid': '5e81bec2-2214-4dd9-a984-84d032c0fba2', 'source_volstatus': 'available'} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:29 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d" returned: 0 in 0.932s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.254s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:29 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Cloning volume 5e81bec2-2214-4dd9-a984-84d032c0fba2 to volume f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f6c439-c663-4be0-a793-e6919217b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979cd319-b302-45e0-9866-c4783fa8172d', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a95eae-f404-4295-b310-a12d2dffc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:29 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Volume volume-979cd319-b302-45e0-9866-c4783fa8172d (979cd319-b302-45e0-9866-c4783fa8172d): created successfully Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a95eae-f404-4295-b310-a12d2dffc956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (75b39eca-d975-46c2-869b-eb57d2461eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Creating offline snapshot c0560a2c-71a7-487c-a224-6d6687168873 of volume 5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 15:59:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a25754eb-0c29-4230-85b4-97f4320458cd tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42380ed-e54c-4383-90c9-c5737a1cecdc]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:29 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:29 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:30 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 0.891s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:30 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 1G Jun 23 15:59:30 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-979cd319-b302-45e0-9866-c4783fa8172d-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "cinder-979cd319-b302-45e0-9866-c4783fa8172d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-979cd319-b302-45e0-9866-c4783fa8172d" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-979cd319-b302-45e0-9866-c4783fa8172d" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbad6dc-9962-4364-b6ab-491389ab99af]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:31 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d Jun 23 15:59:31 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:31 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 1G" returned: 0 in 1.054s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:31 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:31 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:31 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d" returned: 0 in 0.961s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:31 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d Jun 23 15:59:31 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:32 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 0.696s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:32 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 is being set with open permissions: ugo+rw Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:32 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:32 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:32 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-979cd319-b302-45e0-9866-c4783fa8172d" returned: 0 in 0.691s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-979cd319-b302-45e0-9866-c4783fa8172d" released by "delete_volume" :: held 1.695s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Created reservations ['f4dd4fbf-5b42-48d2-bfb3-0ce4152c88dc', '770fd810-1bc8-45eb-8745-a81f3b43cde7', 'a3749597-6a69-4dd2-806f-8ad6ae19aa38', 'dd21158f-8b41-4d7f-ad35-bd7b6d6802fe'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:32 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:32 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-09f75ea1-255c-455a-8c21-9e277a3baa08-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:33 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 0.672s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "cinder-09f75ea1-255c-455a-8c21-9e277a3baa08-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:33 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info Jun 23 15:59:33 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[726300ad-37e4-43da-82a9-3ddb7cff77a5]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:33 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 Jun 23 15:59:33 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:33 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.744s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-997e7a76-8e02-4c68-8bcf-1a9f6203404a tempest-VolumesGetTest-1789803864 None] Lock "cinder-979cd319-b302-45e0-9866-c4783fa8172d-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:33 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info" returned: 0 in 0.677s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:33 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info is being set with open permissions: ugo+rw Jun 23 15:59:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:33 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info Jun 23 15:59:33 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:34 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08" returned: 0 in 0.816s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:34 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08 Jun 23 15:59:34 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:34 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.info" returned: 0 in 0.703s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] snapshot: c0560a2c-71a7-487c-a224-6d6687168873, volume: f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18804d-1212-4924-94fb-2bba83bf1156]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:34 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-09f75ea1-255c-455a-8c21-9e277a3baa08" returned: 0 in 0.682s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-09f75ea1-255c-455a-8c21-9e277a3baa08" released by "delete_volume" :: held 1.605s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Created reservations ['3c34e53d-d7a7-4ebb-8da1-7eecfffec5b3', '7903ce94-f86a-478f-92a2-2732bfcf3a5d', 'c6604e24-8870-4b8f-88d5-b51d674e5011', '062f10e8-e78c-410d-b613-0601c4677ff6'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:59:34 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:34 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:35 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:35 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-31480fcc-abc0-479f-85dd-cb4094897455-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "cinder-31480fcc-abc0-479f-85dd-cb4094897455-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-31480fcc-abc0-479f-85dd-cb4094897455" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-31480fcc-abc0-479f-85dd-cb4094897455" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1cd0e-f207-4651-8730-de95f6e8c018]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:35 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:35 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:35 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.855s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e86c3658-e2e6-4906-ae51-eb5eaf0d6a4b tempest-VolumesGetTest-1789803864 None] Lock "cinder-09f75ea1-255c-455a-8c21-9e277a3baa08-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:35 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 1.325s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e81bec2-2214-4dd9-a984-84d032c0fba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[558b766e-4f33-4a05-8d1b-ab8dbc8adb25]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:36 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:36 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:36 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 0.998s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:36 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455 Jun 23 15:59:36 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:36 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 0.909s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:36 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 15:59:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:36 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e Jun 23 15:59:36 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:37 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-31480fcc-abc0-479f-85dd-cb4094897455" returned: 0 in 0.653s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-31480fcc-abc0-479f-85dd-cb4094897455" released by "delete_volume" :: held 1.731s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Created reservations ['e51bc800-65ce-46e3-a2e6-873a65fe872a', '8bcc2ca1-226d-41a7-a0d8-4647c8594a29', '1c09fc00-7ada-40f7-8ebd-dd6ca5ae5076', 'd78c21ea-e82f-471f-8a85-b67cfb3c176f'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:37 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:37 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:39 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.604s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:39 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 15:59:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-160f09ac-d4bb-48b3-873c-40bd9c5864be tempest-VolumesGetTest-1789803864 None] Lock "cinder-31480fcc-abc0-479f-85dd-cb4094897455-delete_volume" released by "delete_volume" :: held 3.720s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (2f65a451-a6d8-4d4a-88fd-f95f65853fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b26fdf7-aa3a-4e30-895d-2329ed4d57ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b26fdf7-aa3a-4e30-895d-2329ed4d57ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2008947997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e88ed2c-0bab-48a4-9f09-d650c9406b25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:41Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd20966-a311-497a-a499-0a67caaee929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd20966-a311-497a-a499-0a67caaee929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a53034-11ec-4d36-ae05-f9d952ec4290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:41 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 15:59:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a53034-11ec-4d36-ae05-f9d952ec4290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e88ed2c-0bab-48a4-9f09-d650c9406b25', 'volume_name': 'volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1fda40-6761-406b-9827-716731201a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1fda40-6761-406b-9827-716731201a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554ea77e-8bec-4c45-a2aa-fd3fe36589bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 15:59:42 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Trying to clone 7e88ed2c-0bab-48a4-9f09-d650c9406b25 from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 15:59:43 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD, size 20.69 MB, duration 1.12 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 15:59:43 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Image download 20.69 MB at 18.44 MB/s Jun 23 15:59:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb829f96-b03a-4993-b860-4b8d3395dfba]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:43 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD Jun 23 15:59:43 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:44 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" returned: 0 in 7.161s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b25f2bd-e961-4b66-a2b8-5cac994bee95]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:44 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:44 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (35de4418-270e-451e-bfac-a5ed1243b64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e91220-21a9-41ac-be3f-999734601325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e91220-21a9-41ac-be3f-999734601325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120083534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d924655-f687-462e-8f62-540d5a40fe1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:45Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02544df1-cd11-403b-ae7d-cdb17acd0e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02544df1-cd11-403b-ae7d-cdb17acd0e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f32f7f-bb61-4053-90b9-b24b259bb0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f32f7f-bb61-4053-90b9-b24b259bb0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d924655-f687-462e-8f62-540d5a40fe1c', 'volume_name': 'volume-1d924655-f687-462e-8f62-540d5a40fe1c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe435f0d-5497-427b-96c7-22c8ed539ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe435f0d-5497-427b-96c7-22c8ed539ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9cc842-53af-4626-b3e7-029d3c6d2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:44 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Volume 1d924655-f687-462e-8f62-540d5a40fe1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d924655-f687-462e-8f62-540d5a40fe1c', 'volume_size': 1} Jun 23 15:59:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:45 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD" returned: 0 in 1.480s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 is fetched for user 194ab8650e9f4ffca6934a59a792a683. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8fc1f-12cc-4050-be8b-d9a980c7e3a9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:45 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD Jun 23 15:59:45 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:45 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 1.866s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:59:45 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Converted 1024.00 MB image at 142.97 MB/s Jun 23 15:59:45 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e is being set with open permissions: ugo+rw Jun 23 15:59:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:46 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e Jun 23 15:59:46 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:46 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:46 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" returned: 0 in 0.741s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" released by "_copy_volume_from_snapshot" :: held 12.132s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-quobyte-c0560a2c-71a7-487c-a224-6d6687168873" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-c0560a2c-71a7-487c-a224-6d6687168873" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Deleting offline snapshot c0560a2c-71a7-487c-a224-6d6687168873 of volume 5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] snapshot_file for this snap is: volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be98c33e-baf1-4a7f-951e-ef8954941c81]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:46 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:46 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:47 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 0.828s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e81bec2-2214-4dd9-a984-84d032c0fba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 15:59:47 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bdc68b-66aa-4754-8dfe-41fc86c292f2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:47 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:47 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:48 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 0.906s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:48 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:48 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:49 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 0.892s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:49 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873 Jun 23 15:59:49 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:50 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2.c0560a2c-71a7-487c-a224-6d6687168873" returned: 0 in 0.663s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-c0560a2c-71a7-487c-a224-6d6687168873" released by "_delete_snapshot" :: held 3.488s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.584s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.406s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120083534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d924655-f687-462e-8f62-540d5a40fe1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:45Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Creating volume 1d924655-f687-462e-8f62-540d5a40fe1c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:59:50 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1528470e-8b49-4a13-b28d-c722b2691b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e', 'volume_size': 2, 'source_volid': '5e81bec2-2214-4dd9-a984-84d032c0fba2', 'source_volstatus': 'available'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:50 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c 1073741824 Jun 23 15:59:50 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aa4263-8b0b-451d-b063-cb8bffb3cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Volume volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e (f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e): created successfully Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aa4263-8b0b-451d-b063-cb8bffb3cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Flow 'volume_create_manager' (b4c15800-beb2-4aec-9ca8-325aaa663efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bf53b1b0-defd-4e4d-80ac-06ec94cd2948 tempest-VolumesCloneTest-1946118279 None] Created volume successfully. Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" acquired by "delete_volume" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[27172ada-1fda-4a52-8773-69b027d3ab36]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:51 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e Jun 23 15:59:51 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:51 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c 1073741824" returned: 0 in 1.097s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:51 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c Jun 23 15:59:51 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:51 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" returned: 0 in 0.968s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:51 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e Jun 23 15:59:51 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:52 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c" returned: 0 in 0.639s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.935s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2008947997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e88ed2c-0bab-48a4-9f09-d650c9406b25,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T13:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T13:59:41Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Creating volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 15:59:52 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9cc842-53af-4626-b3e7-029d3c6d2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d924655-f687-462e-8f62-540d5a40fe1c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:52 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1073741824 Jun 23 15:59:52 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8e767-120d-4cc0-b020-3cee4376be85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Volume volume-1d924655-f687-462e-8f62-540d5a40fe1c (1d924655-f687-462e-8f62-540d5a40fe1c): created successfully Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f8e767-120d-4cc0-b020-3cee4376be85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (35de4418-270e-451e-bfac-a5ed1243b64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:52 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dd0cc2b5-ac64-483f-823e-0c75c78754d1 tempest-AttachVolumeTestJSON-1963781098 None] Created volume successfully. Jun 23 15:59:52 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" returned: 0 in 0.812s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e" released by "delete_volume" :: held 1.855s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Created reservations ['f0971bb8-522a-4c7d-96a5-ed4ea74e7140', 'f164453f-b926-4930-9893-3cd449046eb7', 'e9c8c68b-4d5c-45a9-90f5-9a7c34bb412c', 'e293e463-4abe-4835-b98f-95603bab262d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:52 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:52 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-5e81bec2-2214-4dd9-a984-84d032c0fba2-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-5e81bec2-2214-4dd9-a984-84d032c0fba2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "cinder-quobyte-5e81bec2-2214-4dd9-a984-84d032c0fba2" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 15:59:53 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1073741824" returned: 0 in 1.141s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-5e81bec2-2214-4dd9-a984-84d032c0fba2" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007cdea-811d-4033-ad5e-abc716880fd1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:53 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 15:59:53 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:53 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:53 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:53 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.987s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Deleted volume successfully. Jun 23 15:59:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-94fe06e1-a238-4a12-bffe-98c7ca275fb4 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-f1288c46-a4ef-4dd6-84c2-f90d6eb47a9e-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:54 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 0 in 0.828s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Attempting download of 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb66ccf-711b-4327-8496-31c6ccfe3be3]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:54 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 1.113s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:54 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g Jun 23 15:59:54 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:54 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2 Jun 23 15:59:54 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:55 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e81bec2-2214-4dd9-a984-84d032c0fba2" returned: 0 in 0.625s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-quobyte-5e81bec2-2214-4dd9-a984-84d032c0fba2" released by "delete_volume" :: held 1.859s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:55 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g" returned: 0 in 0.809s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Created reservations ['8655c82b-b2cf-4cbc-a120-5fec3d42dda7', 'fd57540f-b3ad-4e64-a757-191659355587', '6fabba84-7954-466f-8cdb-225f808e31ab', 'd0654f35-ebf5-4a32-b2c1-cafb1ee653f7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 15:59:55 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g Jun 23 15:59:55 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:55 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 15:59:55 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:56 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g" returned: 1 in 0.887s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_ypk7ec8g' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32945ba-aac4-44b4-9be3-c9cb00196f14]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:56 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD Jun 23 15:59:56 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:56 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.189s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 15:59:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Deleted volume successfully. Jun 23 15:59:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-208d91b5-c236-47bd-8be8-3751641e6598 tempest-VolumesCloneTest-1946118279 None] Lock "cinder-5e81bec2-2214-4dd9-a984-84d032c0fba2-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 15:59:57 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD" returned: 0 in 1.077s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] 6aac4d99-2f53-4de8-8fee-643558b40ac5 was qcow2, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:57 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 15:59:57 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891ef62-b59a-480c-87b1-ba82881996a9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 15:59:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:57 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c Jun 23 15:59:57 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:58 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c" returned: 0 in 1.085s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.114s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 15:59:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-1d924655-f687-462e-8f62-540d5a40fe1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e917210-a1bf-4ec1-a20a-08d4c6d9bca2', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 15:59:58 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-49612ae6-7a25-4e82-8c2f-bd3adb6aca3c req-67c4b39e-ee24-48a5-841b-f8631364ad3f tempest-AttachVolumeTestJSON-1963781098 None] attachment_update completed successfully. Jun 23 15:59:59 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 0 in 2.447s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_g0kanmvtdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 15:59:59 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Converted 112.00 MB image at 45.76 MB/s Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 15:59:59 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1G Jun 23 15:59:59 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Flow 'volume_create_manager' (357bbc31-1f4c-45f4-8bd4-b7edb0163f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da453cf-e8af-4d16-be86-df1c21960bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da453cf-e8af-4d16-be86-df1c21960bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1691335881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31460eb-f11e-420b-9bb1-521afd9e4fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9513f2bac7544569406a89550df3a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:00Z,use_quota=True,user_id='4a5de7e389344540bdd772c91eedff5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788059f8-1469-4d06-9d73-5ba82fb4286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788059f8-1469-4d06-9d73-5ba82fb4286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a6766a-d884-43ba-8b97-9f29a77112d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a6766a-d884-43ba-8b97-9f29a77112d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b31460eb-f11e-420b-9bb1-521afd9e4fab', 'volume_name': 'volume-b31460eb-f11e-420b-9bb1-521afd9e4fab', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0354c114-dab4-452e-a08b-76c1546d61d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0354c114-dab4-452e-a08b-76c1546d61d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab258e7-0d22-4bbf-bb30-6cd00148238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 15:59:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Volume b31460eb-f11e-420b-9bb1-521afd9e4fab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b31460eb-f11e-420b-9bb1-521afd9e4fab', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 15:59:59 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Trying to clone b31460eb-f11e-420b-9bb1-521afd9e4fab from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:00:00 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:00:00 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 1G" returned: 0 in 0.827s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639bcb2-9fc3-46fc-9fcc-1c2d5001d7d6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c320c09-ddc0-4f19-a11c-0802b613c8d7]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:00 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 16:00:00 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:00 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD Jun 23 16:00:00 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:01 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 is fetched for user 4a5de7e389344540bdd772c91eedff5d. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:00:01 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 0 in 0.750s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f8aa1-637e-46ab-b9f3-d70aef81bd9e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:01 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 16:00:01 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:01 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD Jun 23 16:00:01 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:01 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1691335881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31460eb-f11e-420b-9bb1-521afd9e4fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9513f2bac7544569406a89550df3a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:00Z,use_quota=True,user_id='4a5de7e389344540bdd772c91eedff5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Creating volume b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:01 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:01 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 1 in 0.812s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Downloaded image 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 for user 194ab8650e9f4ffca6934a59a792a683 is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Marking volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:00:02 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1073741824 Jun 23 16:00:02 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Copying metadata from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 to 7e88ed2c-0bab-48a4-9f09-d650c9406b25. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Creating volume glance metadata for volume 7e88ed2c-0bab-48a4-9f09-d650c9406b25 backed by image 6aac4d99-2f53-4de8-8fee-643558b40ac5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554ea77e-8bec-4c45-a2aa-fd3fe36589bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432aaacf-1ff0-4c3c-97a2-ce65d946b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Volume volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 (7e88ed2c-0bab-48a4-9f09-d650c9406b25): created successfully Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432aaacf-1ff0-4c3c-97a2-ce65d946b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (2f65a451-a6d8-4d4a-88fd-f95f65853fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-535435b2-406c-437e-a5d7-eb9b0c1ad7fe tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 16:00:02 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1073741824" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:02 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:02 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:03 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 0.701s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Attempting download of 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume b31460eb-f11e-420b-9bb1-521afd9e4fab. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c8ea28-809c-460d-afb9-f468a49c7038]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:03 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat Jun 23 16:00:03 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:03 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (3615219c-a4a8-474a-a47e-8a2731044b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465a57ed-cd50-4cbb-a94b-74321a8f0342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465a57ed-cd50-4cbb-a94b-74321a8f0342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778056224',display_name='tempest-VolumesGetTest-Volume-88996842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c226c68-99df-49f3-9eda-63c89366ba17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:04Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f0c9ea-a0e3-441e-9d51-5a28303b6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f0c9ea-a0e3-441e-9d51-5a28303b6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d596565-e04f-459b-a608-253e2f127776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d596565-e04f-459b-a608-253e2f127776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c226c68-99df-49f3-9eda-63c89366ba17', 'volume_name': 'volume-5c226c68-99df-49f3-9eda-63c89366ba17', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bad278a-39f0-4214-829a-057ed50c703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bad278a-39f0-4214-829a-057ed50c703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64aefbba-6f7e-40a5-a722-ac1b39d3390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Volume 5c226c68-99df-49f3-9eda-63c89366ba17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c226c68-99df-49f3-9eda-63c89366ba17', 'volume_size': 1} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-778056224',display_name='tempest-VolumesGetTest-Volume-88996842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c226c68-99df-49f3-9eda-63c89366ba17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbabd756a484549b3593778ffcd0706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:04Z,use_quota=True,user_id='194ab8650e9f4ffca6934a59a792a683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Creating volume 5c226c68-99df-49f3-9eda-63c89366ba17 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:04 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:04 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 1073741824 Jun 23 16:00:04 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (ec55700b-d16d-4b14-9d6b-7711050ac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e9d8b0-c711-4068-b48b-200663dc76c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e9d8b0-c711-4068-b48b-200663dc76c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2036525103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c3c3c-9589-41a6-a5fd-bab915eebb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:04Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793670ae-f124-4ff8-be20-a8375fa33d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793670ae-f124-4ff8-be20-a8375fa33d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc12cab-dec6-4a0a-9f14-482db1e563b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc12cab-dec6-4a0a-9f14-482db1e563b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6c3c3c-9589-41a6-a5fd-bab915eebb09', 'volume_name': 'volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be41148-26db-4e37-ba20-2842a8d25e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be41148-26db-4e37-ba20-2842a8d25e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47957c39-449b-4ac6-8c6b-e404dc63accb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Volume 4d6c3c3c-9589-41a6-a5fd-bab915eebb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09', 'volume_size': 1} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:04 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat" returned: 0 in 0.777s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:04 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat Jun 23 16:00:04 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:04 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 1073741824" returned: 0 in 0.845s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:04 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 Jun 23 16:00:04 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:05 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat" returned: 1 in 0.759s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_685cyoat' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc4292-8451-49d4-be4a-c01fe80668fd]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:05 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD Jun 23 16:00:05 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:05 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17" returned: 0 in 0.663s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2036525103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c3c3c-9589-41a6-a5fd-bab915eebb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1b51578b964cb8aaa232684327a2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:04Z,use_quota=True,user_id='6195425bdd904a8099429e8e6462b766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Creating volume 4d6c3c3c-9589-41a6-a5fd-bab915eebb09 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:05 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:05 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 1073741824 Jun 23 16:00:05 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64aefbba-6f7e-40a5-a722-ac1b39d3390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c226c68-99df-49f3-9eda-63c89366ba17', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5a9daf-ec53-4ddf-96ee-daeb2862eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:05 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Volume volume-5c226c68-99df-49f3-9eda-63c89366ba17 (5c226c68-99df-49f3-9eda-63c89366ba17): created successfully Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5a9daf-ec53-4ddf-96ee-daeb2862eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Flow 'volume_create_manager' (3615219c-a4a8-474a-a47e-8a2731044b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e48057a4-a4f0-48c3-8360-0e9d303ce5f2 tempest-VolumesGetTest-1789803864 None] Created volume successfully. Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:05 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:05 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:06 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] 6aac4d99-2f53-4de8-8fee-643558b40ac5 was qcow2, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:06 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:06 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-5c226c68-99df-49f3-9eda-63c89366ba17-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "cinder-5c226c68-99df-49f3-9eda-63c89366ba17-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-5c226c68-99df-49f3-9eda-63c89366ba17" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-5c226c68-99df-49f3-9eda-63c89366ba17" acquired by "delete_volume" :: waited 0.039s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ef478-5aca-4660-90a5-9510e09e462e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:06 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 Jun 23 16:00:06 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:06 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.948s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:00:06 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 1073741824" returned: 0 in 1.298s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:07 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 Jun 23 16:00:07 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:07 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17" returned: 0 in 0.922s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:07 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17 Jun 23 16:00:07 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:07 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" returned: 0 in 0.816s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47957c39-449b-4ac6-8c6b-e404dc63accb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e4d5d9-a940-4b1c-bd96-b41d67bc9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:07 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Volume volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 (4d6c3c3c-9589-41a6-a5fd-bab915eebb09): created successfully Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e4d5d9-a940-4b1c-bd96-b41d67bc9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Flow 'volume_create_manager' (ec55700b-d16d-4b14-9d6b-7711050ac950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c8ed809b-16d7-4b74-b3ed-5c9d65a1de2e tempest-AttachVolumeTestJSON-1963781098 None] Created volume successfully. Jun 23 16:00:08 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5c226c68-99df-49f3-9eda-63c89366ba17" returned: 0 in 0.822s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-5c226c68-99df-49f3-9eda-63c89366ba17" released by "delete_volume" :: held 1.801s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Created reservations ['dc1b41a0-4d98-4fa4-b326-5425a1fc918a', '967f436f-f96f-4d1d-91ec-b6beda163034', 'a640a5ca-4ba1-4074-b7ea-630da26e806a', '38303fe5-14a1-4ea3-9207-d30fd0badaaf'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:08 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:08 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:08 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 2.394s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_10wv3mnrdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:00:08 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Converted 112.00 MB image at 46.72 MB/s Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:08 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1G Jun 23 16:00:08 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-7e88ed2c-0bab-48a4-9f09-d650c9406b25-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "cinder-7e88ed2c-0bab-48a4-9f09-d650c9406b25-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Acquiring lock "cinder-quobyte-7e88ed2c-0bab-48a4-9f09-d650c9406b25" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-7e88ed2c-0bab-48a4-9f09-d650c9406b25" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4094a-de12-4e3e-a31b-86fbd82fd895]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:09 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 16:00:09 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:09 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.885s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0b7b66b3-88d0-4dd0-a4de-f7be00a99ac8 tempest-VolumesGetTest-1789803864 None] Lock "cinder-5c226c68-99df-49f3-9eda-63c89366ba17-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:09 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 1G" returned: 0 in 0.939s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (25751311-f811-4994-8248-99049320a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7bbc79-1438-4c57-ba7f-a372122fad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2ceb76-26cd-4562-b58e-f4ca5ee0b4d0]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7bbc79-1438-4c57-ba7f-a372122fad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-287898710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7111a3f-bd50-45a8-8e06-8e295995c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:09Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a793e6e1-387b-43c3-ae7e-09b357f86d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a793e6e1-387b-43c3-ae7e-09b357f86d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b0fe78-52e6-4164-9e05-9d7b859a04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b0fe78-52e6-4164-9e05-9d7b859a04cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7111a3f-bd50-45a8-8e06-8e295995c631', 'volume_name': 'volume-a7111a3f-bd50-45a8-8e06-8e295995c631', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ee39d7-064e-46c0-91e0-d5e7293aea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ee39d7-064e-46c0-91e0-d5e7293aea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a12be9-55df-445e-beee-61bec3ff637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Volume a7111a3f-bd50-45a8-8e06-8e295995c631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7111a3f-bd50-45a8-8e06-8e295995c631', 'volume_size': 1} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-287898710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7111a3f-bd50-45a8-8e06-8e295995c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320b313e895040dd8467a00f43877431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:09Z,use_quota=True,user_id='1b94ead305b94c709831fc15f706ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Creating volume a7111a3f-bd50-45a8-8e06-8e295995c631 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:09 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:09 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:09 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:09 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 1073741824 Jun 23 16:00:09 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:09 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 0 in 0.976s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:09 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 16:00:09 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:10 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 0.824s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:10 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:10 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:10 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 1073741824" returned: 0 in 0.947s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:10 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 Jun 23 16:00:10 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:10 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 1 in 0.897s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:10 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25 Jun 23 16:00:10 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:11 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 1 in 0.861s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Downloaded image 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume b31460eb-f11e-420b-9bb1-521afd9e4fab successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 for user 4a5de7e389344540bdd772c91eedff5d is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Marking volume b31460eb-f11e-420b-9bb1-521afd9e4fab as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Copying metadata from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 to b31460eb-f11e-420b-9bb1-521afd9e4fab. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Creating volume glance metadata for volume b31460eb-f11e-420b-9bb1-521afd9e4fab backed by image 6aac4d99-2f53-4de8-8fee-643558b40ac5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:00:11 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631" returned: 0 in 0.757s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a12be9-55df-445e-beee-61bec3ff637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7111a3f-bd50-45a8-8e06-8e295995c631', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1260eef-d728-41d7-bf77-2cbbf5be71e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab258e7-0d22-4bbf-bb30-6cd00148238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31460eb-f11e-420b-9bb1-521afd9e4fab', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81da27fa-616c-4648-b93f-e3d7dfd11258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Volume volume-a7111a3f-bd50-45a8-8e06-8e295995c631 (a7111a3f-bd50-45a8-8e06-8e295995c631): created successfully Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1260eef-d728-41d7-bf77-2cbbf5be71e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Flow 'volume_create_manager' (25751311-f811-4994-8248-99049320a533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Volume volume-b31460eb-f11e-420b-9bb1-521afd9e4fab (b31460eb-f11e-420b-9bb1-521afd9e4fab): created successfully Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81da27fa-616c-4648-b93f-e3d7dfd11258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Flow 'volume_create_manager' (357bbc31-1f4c-45f4-8bd4-b7edb0163f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e0fb4781-b020-4c17-9318-dba2f8580ef8 tempest-AttachVolumeNegativeTest-343860166 None] Created volume successfully. Jun 23 16:00:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e6827b03-c39b-4447-9119-2a02efc86d68 tempest-VolumesExtendTest-1768085787 None] Created volume successfully. Jun 23 16:00:11 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7e88ed2c-0bab-48a4-9f09-d650c9406b25" returned: 0 in 0.726s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "cinder-quobyte-7e88ed2c-0bab-48a4-9f09-d650c9406b25" released by "delete_volume" :: held 2.692s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Created reservations ['b10e6a05-68d3-4721-a3f1-8c5e6f574730', '3a7df955-fa87-4853-a6f4-d6e72f3f4b75', 'a141fb56-5839-4a4a-9073-383b0d991ad3', 'b8f7fe60-0973-4dd8-9eed-1b0eefacde91'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:11 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:11 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e19bd-59c2-4621-9ce3-14b0831f5727]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:11 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 Jun 23 16:00:11 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:12 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.696s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Deleted volume successfully. Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6042b8a6-7a76-47dc-bf4f-4257897abd55 tempest-VolumesGetTest-1789803864 None] Lock "cinder-7e88ed2c-0bab-48a4-9f09-d650c9406b25-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:12 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" returned: 0 in 0.806s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eecf643f-2796-4dea-a0e6-a836baf2d2b9', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:00:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-cc9e37df-9b43-46c5-be27-d2c7ba0e0a5e req-8b633125-50bd-40aa-ab39-6f4e2f55881b tempest-AttachVolumeTestJSON-1963781098 None] attachment_update completed successfully. Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5389c3-2543-4ef4-8eda-f1a079e71565]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:12 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:12 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:13 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 0.951s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:13 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:13 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:14 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 1 in 0.792s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 2G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab 2G" returned: 0 in 0.056s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.870s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-23d0c955-b929-46dd-ac35-449d5b713b13 tempest-VolumesExtendTest-1768085787 None] Extend volume completed successfully. Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-b31460eb-f11e-420b-9bb1-521afd9e4fab-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-b31460eb-f11e-420b-9bb1-521afd9e4fab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-quobyte-b31460eb-f11e-420b-9bb1-521afd9e4fab" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-b31460eb-f11e-420b-9bb1-521afd9e4fab" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922ad70-c874-4992-b10b-2b15e2ef1e18]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:15 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:15 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec0e72d-a055-4b95-8537-4424ac54bc0e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:15 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 Jun 23 16:00:15 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:16 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:16 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:16 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:16 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631" returned: 0 in 0.915s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-a7111a3f-bd50-45a8-8e06-8e295995c631', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a6eb3fc-12c4-47da-96f6-4e2a68af2e74', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:00:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-b8594390-96be-439b-92b9-c94d141a10f2 req-d2c7c457-023d-463a-8b49-3005969f3d39 tempest-AttachVolumeNegativeTest-343860166 None] attachment_update completed successfully. Jun 23 16:00:17 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 1 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:17 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab Jun 23 16:00:17 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:17 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b31460eb-f11e-420b-9bb1-521afd9e4fab" returned: 0 in 0.710s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-b31460eb-f11e-420b-9bb1-521afd9e4fab" released by "delete_volume" :: held 2.656s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:17 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Created reservations ['5726523a-e39c-4ebc-a3c6-85bafee7bd56', 'c714fb66-a910-409a-b514-367a92405566', '2da07b05-6e91-4f29-9cef-cad9c76c2e20', '6420871c-b7e9-42fc-8b78-1dde3b721213'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:18 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:18 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Flow 'volume_create_manager' (31d4f60a-7b38-4f6b-9e47-5eb00450ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400d4f3d-ec45-46b5-941d-35f859f7a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400d4f3d-ec45-46b5-941d-35f859f7a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1803144907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12599464-25fd-4b0d-b87c-312142ff80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbecb1ebdf63419394c3be53841fb958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:18Z,use_quota=True,user_id='b8efc94097b143e49c1ad6119ae99e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f9e62f-5ea9-4edf-a425-f1a6501c8368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f9e62f-5ea9-4edf-a425-f1a6501c8368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e0711e-f49b-41ec-8680-ea3309769366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e0711e-f49b-41ec-8680-ea3309769366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12599464-25fd-4b0d-b87c-312142ff80a5', 'volume_name': 'volume-12599464-25fd-4b0d-b87c-312142ff80a5', 'volume_size': 2}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c77866-ff5c-4641-bae6-d7342a9eab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c77866-ff5c-4641-bae6-d7342a9eab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe90136-c132-425d-ac04-eee8845b4d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:18 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Volume 12599464-25fd-4b0d-b87c-312142ff80a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12599464-25fd-4b0d-b87c-312142ff80a5', 'volume_size': 2} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1803144907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12599464-25fd-4b0d-b87c-312142ff80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbecb1ebdf63419394c3be53841fb958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:18Z,use_quota=True,user_id='b8efc94097b143e49c1ad6119ae99e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Creating volume 12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:18 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 2147483648 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:18 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 2147483648 Jun 23 16:00:18 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:18 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.790s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Deleted volume successfully. Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-92286ee8-3285-460a-9045-a53976e14653 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-b31460eb-f11e-420b-9bb1-521afd9e4fab-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-0ad84fcb-77f9-4fcd-9cf9-f0d416dfa718 req-ec6fdc27-dd91-4802-a10e-bc1c09458a43 tempest-AttachVolumeTestJSON-1963781098 None] Terminate volume connection completed successfully. Jun 23 16:00:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-0ad84fcb-77f9-4fcd-9cf9-f0d416dfa718 req-ec6fdc27-dd91-4802-a10e-bc1c09458a43 tempest-AttachVolumeTestJSON-1963781098 None] Deleting attachment 0e917210-a1bf-4ec1-a20a-08d4c6d9bca2. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Flow 'volume_create_manager' (d59f165f-85c9-41ed-a801-7e665c4474f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6492878d-76f9-4581-82ae-59b4e5e4a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6492878d-76f9-4581-82ae-59b4e5e4a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-757251494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e120410-25c7-4659-903b-7e999e51a076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9513f2bac7544569406a89550df3a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:19Z,use_quota=True,user_id='4a5de7e389344540bdd772c91eedff5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67a2cbb-b5f8-44e4-87c8-1f0a3f0dfd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67a2cbb-b5f8-44e4-87c8-1f0a3f0dfd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbb7da6-e5e2-4b63-82cf-7aee2d54bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbb7da6-e5e2-4b63-82cf-7aee2d54bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e120410-25c7-4659-903b-7e999e51a076', 'volume_name': 'volume-5e120410-25c7-4659-903b-7e999e51a076', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726255bd-2629-48ed-a75a-0c70cac5f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726255bd-2629-48ed-a75a-0c70cac5f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9dd6e1-9d06-48c5-93b7-04297cbab7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:19 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Volume 5e120410-25c7-4659-903b-7e999e51a076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e120410-25c7-4659-903b-7e999e51a076', 'volume_size': 1} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:19 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 2147483648" returned: 0 in 0.973s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:19 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 Jun 23 16:00:19 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:20 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5" returned: 0 in 0.695s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-757251494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e120410-25c7-4659-903b-7e999e51a076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9513f2bac7544569406a89550df3a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:19Z,use_quota=True,user_id='4a5de7e389344540bdd772c91eedff5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Creating volume 5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:20 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe90136-c132-425d-ac04-eee8845b4d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12599464-25fd-4b0d-b87c-312142ff80a5', 'volume_size': 2}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:20 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 1073741824 Jun 23 16:00:20 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebfa896-7974-4f5b-88c9-68abc037c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:20 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Volume volume-12599464-25fd-4b0d-b87c-312142ff80a5 (12599464-25fd-4b0d-b87c-312142ff80a5): created successfully Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebfa896-7974-4f5b-88c9-68abc037c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Flow 'volume_create_manager' (31d4f60a-7b38-4f6b-9e47-5eb00450ed34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3b1a3b9a-68f1-4d6d-b1e2-1a89b5c6e6f0 tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Created volume successfully. Jun 23 16:00:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:21 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 1073741824" returned: 0 in 0.924s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=110,cinder:SELECT=105,cinder:INSERT=36,cinder:DELETE=10 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=111,cinder:SELECT=94,cinder:INSERT=35,cinder:DELETE=9 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:21 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:21 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-caa52b72-8dba-4962-97ac-cb122e6a10a0 req-2cd98aee-c39b-4ad7-8b83-808f5841d2ca tempest-AttachVolumeTestJSON-1963781098 None] Terminate volume connection completed successfully. Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-caa52b72-8dba-4962-97ac-cb122e6a10a0 req-2cd98aee-c39b-4ad7-8b83-808f5841d2ca tempest-AttachVolumeTestJSON-1963781098 None] Deleting attachment eecf643f-2796-4dea-a0e6-a836baf2d2b9. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:00:21 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 0.644s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.230s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Creating offline snapshot f8d95806-48b1-4efc-99e8-a3362bdd7c16 of volume 12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9dd6e1-9d06-48c5-93b7-04297cbab7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e120410-25c7-4659-903b-7e999e51a076', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85de8480-98ab-4603-99b7-815f065535c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfafcb-6881-469e-81e9-a91f5cce34b8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Volume volume-5e120410-25c7-4659-903b-7e999e51a076 (5e120410-25c7-4659-903b-7e999e51a076): created successfully Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85de8480-98ab-4603-99b7-815f065535c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Flow 'volume_create_manager' (d59f165f-85c9-41ed-a801-7e665c4474f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3dd81a6e-5645-430c-8a81-8cfdefaf5ed2 tempest-VolumesExtendTest-1768085787 None] Created volume successfully. Jun 23 16:00:21 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 Jun 23 16:00:21 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:22 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5" returned: 0 in 0.831s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 2G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:22 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 2G Jun 23 16:00:22 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-02ee3fa1-5ccf-4760-b83f-6058c1daf3b4 req-b7107152-743c-4e07-8cf5-584769176bf5 tempest-AttachVolumeNegativeTest-343860166 None] Terminate volume connection completed successfully. Jun 23 16:00:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-02ee3fa1-5ccf-4760-b83f-6058c1daf3b4 req-b7107152-743c-4e07-8cf5-584769176bf5 tempest-AttachVolumeNegativeTest-343860166 None] Deleting attachment 2a6eb3fc-12c4-47da-96f6-4e2a68af2e74. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:00:23 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 2G" returned: 0 in 0.868s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12599464-25fd-4b0d-b87c-312142ff80a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:23 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12599464-25fd-4b0d-b87c-312142ff80a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 Jun 23 16:00:23 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:24 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12599464-25fd-4b0d-b87c-312142ff80a5 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16" returned: 0 in 0.705s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:24 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 is being set with open permissions: ugo+rw Jun 23 16:00:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:24 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 Jun 23 16:00:24 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:24 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16" returned: 0 in 0.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:25 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info Jun 23 16:00:25 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:25 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info" returned: 0 in 0.836s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:25 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info is being set with open permissions: ugo+rw Jun 23 16:00:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:25 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info Jun 23 16:00:25 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:26 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.info" returned: 0 in 0.835s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.988s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.100s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Creating offline snapshot 0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 of volume 5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:00:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-42140439-5e7a-45a5-a37f-e725cc9c11ec tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Create snapshot completed successfully Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f314de92-64bd-43f9-995d-c888daaab6ae]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:26 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:26 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:27 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 1.126s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:28 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 1G Jun 23 16:00:28 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "cinder-f8d95806-48b1-4efc-99e8-a3362bdd7c16-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-f8d95806-48b1-4efc-99e8-a3362bdd7c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "cinder-quobyte-f8d95806-48b1-4efc-99e8-a3362bdd7c16" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-f8d95806-48b1-4efc-99e8-a3362bdd7c16" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Deleting offline snapshot f8d95806-48b1-4efc-99e8-a3362bdd7c16 of volume 12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] snapshot_file for this snap is: volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b99a42-77a0-435b-9f45-39f5981d5d80]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:28 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 Jun 23 16:00:28 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:29 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 1G" returned: 0 in 1.136s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e120410-25c7-4659-903b-7e999e51a076 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:29 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e120410-25c7-4659-903b-7e999e51a076 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 Jun 23 16:00:29 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:29 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16" returned: 0 in 0.950s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12599464-25fd-4b0d-b87c-312142ff80a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7a2392-fbfb-4f62-ba1d-64f94a0b714f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:29 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 Jun 23 16:00:29 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:30 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e120410-25c7-4659-903b-7e999e51a076 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" returned: 0 in 0.906s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:30 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 is being set with open permissions: ugo+rw Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:30 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 Jun 23 16:00:30 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:30 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5" returned: 0 in 1.011s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:30 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 Jun 23 16:00:30 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:30 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" returned: 0 in 0.708s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:30 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info Jun 23 16:00:30 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:31 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16" returned: 0 in 0.813s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:31 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16 Jun 23 16:00:31 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:31 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info" returned: 0 in 0.721s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:31 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info is being set with open permissions: ugo+rw Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:31 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info Jun 23 16:00:31 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:31 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5.f8d95806-48b1-4efc-99e8-a3362bdd7c16" returned: 0 in 0.724s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-f8d95806-48b1-4efc-99e8-a3362bdd7c16" released by "_delete_snapshot" :: held 3.666s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" released by "delete_snapshot" :: held 3.709s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:31 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Created reservations ['65a5f5a2-e74c-45f0-b349-77563fb7982e', '81252999-c685-4ced-a1a4-5f16ab0ff08b', '540c4de5-fb09-4b84-914e-02a9fef0b255', 'd93b840b-89cf-4125-959b-a9aa68bfa069'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Delete snapshot completed successfully. Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b8269216-9dcd-4650-b7ec-b4fe273fc1cf tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-f8d95806-48b1-4efc-99e8-a3362bdd7c16-delete_snapshot" released by "delete_snapshot" :: held 3.928s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:32 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.info" returned: 0 in 0.759s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.524s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e24eb81f-8b90-4294-9069-46ef71fd984e tempest-VolumesExtendTest-1768085787 None] Create snapshot completed successfully Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "cinder-12599464-25fd-4b0d-b87c-312142ff80a5-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-12599464-25fd-4b0d-b87c-312142ff80a5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28a7f5-be45-4b66-bb57-ce7b5bf42437]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-4d6c3c3c-9589-41a6-a5fd-bab915eebb09-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-4d6c3c3c-9589-41a6-a5fd-bab915eebb09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:32 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 Jun 23 16:00:32 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-quobyte-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" acquired by "delete_volume" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f98ee2-50c3-43af-827b-7362619481dc]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:32 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 Jun 23 16:00:32 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9000817-00db-4083-84de-863b75fda0cf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:33 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:33 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:33 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5" returned: 0 in 0.817s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:33 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5 Jun 23 16:00:33 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:33 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" returned: 0 in 0.938s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:33 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09 Jun 23 16:00:33 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:34 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 1.020s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:34 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 2G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-12599464-25fd-4b0d-b87c-312142ff80a5" returned: 0 in 0.871s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-quobyte-12599464-25fd-4b0d-b87c-312142ff80a5" released by "delete_volume" :: held 1.793s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Created reservations ['ea1e3266-0c2f-4214-8f48-8938612dbbd4', '7e8a6998-ea54-438c-ab26-7e8b1e623881', '7298a2a4-78e8-4985-b464-bd5407364bec', '27e1e748-345c-4d28-8a95-6ecc29b9c865'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 2G" returned: 0 in 0.217s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.304s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:34 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:34 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-a7111a3f-bd50-45a8-8e06-8e295995c631-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b3ac2bf5-fccb-465d-ab4e-544eb1e86ca8 tempest-VolumesExtendTest-1768085787 None] Extend volume completed successfully. Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-a7111a3f-bd50-45a8-8e06-8e295995c631-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:34 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" returned: 0 in 0.893s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-quobyte-a7111a3f-bd50-45a8-8e06-8e295995c631" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-4d6c3c3c-9589-41a6-a5fd-bab915eebb09" released by "delete_volume" :: held 1.883s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-a7111a3f-bd50-45a8-8e06-8e295995c631" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed30acf-1d08-4417-bf3d-83f45919684d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Created reservations ['7c397711-cc41-45ec-82ea-3062ddc6c63d', '25393f5a-a34a-4776-ae46-768f507f02c1', '52dce6fe-9128-45bb-b54e-bfaa3384ecde', '63099f99-310e-455b-ac42-b7fca44661bb'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:34 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 Jun 23 16:00:34 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:34 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:34 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-1d924655-f687-462e-8f62-540d5a40fe1c-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-1d924655-f687-462e-8f62-540d5a40fe1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-quobyte-1d924655-f687-462e-8f62-540d5a40fe1c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-1d924655-f687-462e-8f62-540d5a40fe1c" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[829e1bf1-3147-40bf-ac74-04662bd544e0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:35 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c Jun 23 16:00:35 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:35 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.999s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Deleted volume successfully. Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8f07a9c2-3e78-4172-9622-f69f92882dde tempest-VolumesSnapshotNegativeTestJSON-34288122 None] Lock "cinder-12599464-25fd-4b0d-b87c-312142ff80a5-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-quobyte-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Deleting offline snapshot 0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 of volume 5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] snapshot_file for this snap is: volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81029f7-e626-4dde-b038-c63988c841da]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:35 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 Jun 23 16:00:35 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:35 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.094s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Deleted volume successfully. Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-74d21aca-65fb-41d6-8765-b7c4236f50d3 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-4d6c3c3c-9589-41a6-a5fd-bab915eebb09-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:36 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631" returned: 0 in 1.532s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:36 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631 Jun 23 16:00:36 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:36 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c" returned: 0 in 1.325s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:36 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c Jun 23 16:00:36 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:36 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" returned: 0 in 1.148s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e120410-25c7-4659-903b-7e999e51a076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2f9db-9ea4-4a6b-9456-a3fc3f184099]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:37 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a7111a3f-bd50-45a8-8e06-8e295995c631" returned: 0 in 0.855s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:37 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-a7111a3f-bd50-45a8-8e06-8e295995c631" released by "delete_volume" :: held 2.460s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:37 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Created reservations ['dbccd956-41e4-4cec-a70d-75cae81bdbac', 'd636788b-8689-476b-8c8f-821725298bea', 'd5baf8df-b1ed-45c5-9cb8-c7d0a94dd042', 'c92bd2a4-c236-43d4-98ce-76f330f55ead'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:37 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d924655-f687-462e-8f62-540d5a40fe1c" returned: 0 in 0.877s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:37 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:37 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-1d924655-f687-462e-8f62-540d5a40fe1c" released by "delete_volume" :: held 2.283s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Created reservations ['21d12551-214e-4a4e-9102-3623ca77ea21', '133fd091-d4b4-4f28-9fee-55dbea4dfa7f', 'cad202cb-7a9b-4302-87a8-3d359ed78128', '52d5ad98-1392-4077-8369-cbc8a0889f0c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:37 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:37 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:38 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.768s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Deleted volume successfully. Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91b59691-920a-4f5a-b010-d02737e3d4a3 tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-a7111a3f-bd50-45a8-8e06-8e295995c631-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:38 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 1.116s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:38 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 Jun 23 16:00:38 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-96f29853-c837-43bc-b334-fd26e0a0841d-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-96f29853-c837-43bc-b334-fd26e0a0841d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-quobyte-96f29853-c837-43bc-b334-fd26e0a0841d" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-96f29853-c837-43bc-b334-fd26e0a0841d" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e99ac-e252-4fca-aa7c-db987449a11d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:38 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.060s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:38 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:38 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Deleted volume successfully. Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de7ff5d8-208b-4b43-acd0-20a0f89ecbcd tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-1d924655-f687-462e-8f62-540d5a40fe1c-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-17f7d323-34f5-47e9-8c11-b58e9deb8440-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-17f7d323-34f5-47e9-8c11-b58e9deb8440-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "cinder-quobyte-17f7d323-34f5-47e9-8c11-b58e9deb8440" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-17f7d323-34f5-47e9-8c11-b58e9deb8440" acquired by "delete_volume" :: waited 0.038s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218b0cc-bb09-4e51-a8b5-2a7e8b76b92f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:39 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 Jun 23 16:00:39 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:39 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" returned: 0 in 1.201s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:39 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9 Jun 23 16:00:39 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:39 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d" returned: 0 in 1.178s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:39 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d Jun 23 16:00:39 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:40 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440" returned: 0 in 1.113s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:40 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440 Jun 23 16:00:40 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:40 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076.0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" returned: 0 in 0.981s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9" released by "_delete_snapshot" :: held 4.621s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" released by "delete_snapshot" :: held 4.676s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Created reservations ['4c62a5e8-fb92-4070-b8b8-7dfddbee6f7f', 'c72d5537-abd4-462d-8eda-6f5fd91e8bce', 'b040c24d-2ae9-4d6c-9f2a-d814983c2ab6', '88290795-98aa-4fd6-af4b-2b5a52e08073'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:40 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-96f29853-c837-43bc-b334-fd26e0a0841d" returned: 0 in 0.934s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-96f29853-c837-43bc-b334-fd26e0a0841d" released by "delete_volume" :: held 2.196s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Delete snapshot completed successfully. Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a92ab148-6627-45ef-9fdb-91b51915e0ef tempest-VolumesExtendTest-1768085787 None] Lock "cinder-0e5e3727-4dab-4f4b-807d-f1abe9d0a4d9-delete_snapshot" released by "delete_snapshot" :: held 4.942s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Created reservations ['7aad6e22-dd3b-4c6e-a1d2-4acb0e6fb2ef', '059d9b02-6759-4bc9-a8d9-92d2650b1d0e', '57a27f6f-ce9a-49c6-887d-cf32f4375100', 'f545f610-2ce3-47ae-9f66-8825ef25769c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:40 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-17f7d323-34f5-47e9-8c11-b58e9deb8440" returned: 0 in 0.776s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:40 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:40 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-quobyte-17f7d323-34f5-47e9-8c11-b58e9deb8440" released by "delete_volume" :: held 1.956s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:40 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Created reservations ['000a6d7f-a6a5-4df6-8a3c-af00547b0774', '74b3c604-a413-48b4-83c5-182284203fc3', '051ef785-3969-4766-8d87-a316caae746e', '72212832-94a7-477d-9bac-9ae69b51acb6'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:41 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:41 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-5e120410-25c7-4659-903b-7e999e51a076-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-5e120410-25c7-4659-903b-7e999e51a076-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7bcdc0-9189-4ac5-b581-086f72912f1d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:41 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:41 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:41 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.227s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:41 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Deleted volume successfully. Jun 23 16:00:42 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a9141115-f096-406e-ac92-8ff2538046dd tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-96f29853-c837-43bc-b334-fd26e0a0841d-delete_volume" released by "delete_volume" :: held 3.804s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.030s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Deleted volume successfully. Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-656ca4a3-07da-46dc-a003-3ca0d44f3d14 tempest-AttachVolumeTestJSON-1963781098 None] Lock "cinder-17f7d323-34f5-47e9-8c11-b58e9deb8440-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-bfba1b4d-0182-412c-81cd-bbdeccc3f01f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-bfba1b4d-0182-412c-81cd-bbdeccc3f01f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "cinder-quobyte-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669daf8-f7e8-4a07-9f2b-84b5f3929719]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:42 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f Jun 23 16:00:42 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:42 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 1.424s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:43 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076 Jun 23 16:00:43 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:43 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" returned: 0 in 1.110s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:43 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f Jun 23 16:00:43 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:43 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e120410-25c7-4659-903b-7e999e51a076" returned: 0 in 0.816s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-quobyte-5e120410-25c7-4659-903b-7e999e51a076" released by "delete_volume" :: held 2.350s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Created reservations ['96c9c2a5-b851-4f6b-87b6-47d5b69dd415', 'c5d91b51-bce9-4176-b330-cf1a10d9ec84', '1453a2f3-aa20-4140-9b8c-25fc4df820b4', 'c290e2c3-29c0-4c46-92fd-8147d16719dc'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:44 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:44 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:44 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" returned: 0 in 0.978s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-quobyte-bfba1b4d-0182-412c-81cd-bbdeccc3f01f" released by "delete_volume" :: held 2.172s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Created reservations ['bcbd0311-fa1e-43d1-baff-ca2f7d51e4de', 'f47e4d4f-1881-4258-9ad4-4e37571871a6', 'f6b74117-ec3d-4233-805c-7800abcae891', 'aa8da873-2c65-4cb2-8ab0-8774b09547f6'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:44 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:00:44 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:45 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.034s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Deleted volume successfully. Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b42c2518-a090-43a6-b114-514743198d75 tempest-VolumesExtendTest-1768085787 None] Lock "cinder-5e120410-25c7-4659-903b-7e999e51a076-delete_volume" released by "delete_volume" :: held 3.773s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:45 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.829s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:00:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Deleted volume successfully. Jun 23 16:00:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df68e5f9-7ed3-49c3-b5d8-c49396c6a50f tempest-AttachVolumeNegativeTest-343860166 None] Lock "cinder-bfba1b4d-0182-412c-81cd-bbdeccc3f01f-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Flow 'volume_create_manager' (9f1fbb91-7902-4da5-b516-0f935613fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8401da-846b-4e60-b642-527fe54d6067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8401da-846b-4e60-b642-527fe54d6067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1323262433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c11c712-1e9f-4ce7-931c-283282aedaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3fbc87672840d1aff68463a6d4117c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:53Z,use_quota=True,user_id='e943b324473b48d7b3be2b76ad3e968f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f41c1a9-184d-4f26-b067-5e6d2bc7f83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f41c1a9-184d-4f26-b067-5e6d2bc7f83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfbf260-cf3b-4e1e-9e3f-fd04bc27970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfbf260-cf3b-4e1e-9e3f-fd04bc27970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c11c712-1e9f-4ce7-931c-283282aedaf0', 'volume_name': 'volume-8c11c712-1e9f-4ce7-931c-283282aedaf0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e097449d-2ecf-45c1-a29e-ac81cdf0eefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e097449d-2ecf-45c1-a29e-ac81cdf0eefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e666fbee-ab80-43af-9d9e-023a96f47645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Volume 8c11c712-1e9f-4ce7-931c-283282aedaf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c11c712-1e9f-4ce7-931c-283282aedaf0', 'volume_size': 1} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1323262433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c11c712-1e9f-4ce7-931c-283282aedaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3fbc87672840d1aff68463a6d4117c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:53Z,use_quota=True,user_id='e943b324473b48d7b3be2b76ad3e968f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Creating volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:00:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:00:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:53 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 1073741824 Jun 23 16:00:53 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:54 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 1073741824" returned: 0 in 1.259s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:54 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 Jun 23 16:00:54 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:55 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0" returned: 0 in 0.920s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e666fbee-ab80-43af-9d9e-023a96f47645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c11c712-1e9f-4ce7-931c-283282aedaf0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8c65ba-0380-4711-a063-2ac5962ff0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Volume volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 (8c11c712-1e9f-4ce7-931c-283282aedaf0): created successfully Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8c65ba-0380-4711-a063-2ac5962ff0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Flow 'volume_create_manager' (9f1fbb91-7902-4da5-b516-0f935613fc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bd854a8f-32ac-4101-a32c-518f7525be61 tempest-VolumesSnapshotListTestJSON-871008156 None] Created volume successfully. Jun 23 16:00:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:00:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Creating offline snapshot 7209ff52-f9a3-4c12-a70d-2e7ecd777a18 of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:00:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd264129-b94d-48ce-8aec-26ed916ffb35]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:00:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:56 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 Jun 23 16:00:56 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:57 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0" returned: 0 in 1.103s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:57 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 1G Jun 23 16:00:57 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Flow 'volume_create_manager' (ae79bc8b-3f6c-4327-8c22-1f3e8253791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a4093b-a815-4a29-af0e-6571bd641ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a4093b-a815-4a29-af0e-6571bd641ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-632630841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e32d06-ad46-42b9-a1ef-016a61f60395,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1cbb61f8be849658f9bf64efae8caf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:58Z,use_quota=True,user_id='b7e005365b9a4aceac0056929247e6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ac02a5-fb3a-47be-89f4-4be8c0c7af88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ac02a5-fb3a-47be-89f4-4be8c0c7af88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33b6811-544f-448d-8d00-e15071e5c2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33b6811-544f-448d-8d00-e15071e5c2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e32d06-ad46-42b9-a1ef-016a61f60395', 'volume_name': 'volume-94e32d06-ad46-42b9-a1ef-016a61f60395', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f229b-c2a2-4518-acf9-28b6cc846b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f229b-c2a2-4518-acf9-28b6cc846b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8c8b3-9971-48fd-a98e-8bb680f53f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:00:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Volume 94e32d06-ad46-42b9-a1ef-016a61f60395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e32d06-ad46-42b9-a1ef-016a61f60395', 'volume_size': 1} Jun 23 16:00:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:00:59 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jun 23 16:00:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 1G" returned: 0 in 1.244s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:00:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:00:59 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:00:59 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:00 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 0.917s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:00 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 is being set with open permissions: ugo+rw Jun 23 16:01:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:00 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:00 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:00 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 0.952s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:01 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info Jun 23 16:01:01 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:01 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info" returned: 0 in 0.931s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:01 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info is being set with open permissions: ugo+rw Jun 23 16:01:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:02 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info Jun 23 16:01:02 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:02 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.info" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.206s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.649s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-632630841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e32d06-ad46-42b9-a1ef-016a61f60395,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1cbb61f8be849658f9bf64efae8caf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:00:58Z,use_quota=True,user_id='b7e005365b9a4aceac0056929247e6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Creating volume 94e32d06-ad46-42b9-a1ef-016a61f60395 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:02 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:02 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 1073741824 Jun 23 16:01:02 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-244f869d-2894-4298-902e-d5c8657d0ee4 tempest-VolumesSnapshotListTestJSON-871008156 None] Create snapshot completed successfully Jun 23 16:01:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:04 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 1073741824" returned: 0 in 1.304s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:04 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 Jun 23 16:01:04 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Flow 'volume_create_manager' (cc4b0025-94ec-4ee3-abf4-15ad78bae239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53d6548-87b3-46e3-af73-80e337434768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53d6548-87b3-46e3-af73-80e337434768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-347175157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9880c3be-3c53-4b3e-8abc-6cf228e3789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb64916f2574044a3ccbe5be3c19ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:04Z,use_quota=True,user_id='94d38dc78d0348229204b99322d75c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815d43f-3f2f-45d4-9430-baff4616ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8815d43f-3f2f-45d4-9430-baff4616ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4fe746-ef1e-4390-baf9-023a3a156ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4fe746-ef1e-4390-baf9-023a3a156ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9880c3be-3c53-4b3e-8abc-6cf228e3789a', 'volume_name': 'volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa4a586-95a7-47a8-9797-dcfd06178ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa4a586-95a7-47a8-9797-dcfd06178ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae42cb1f-da96-4797-98ac-ccf94c96d938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume 9880c3be-3c53-4b3e-8abc-6cf228e3789a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a', 'volume_size': 1} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4f0cdc4-2c34-4ef3-b221-51ec7b207752 tempest-BackendsCapabilitiesAdminTestsJSON-926998610 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754566192627, 'free_capacity_gb': 1775.754566192627, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93590) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Flow 'volume_create_manager' (a380fc3e-ea3e-4f59-bb9e-4d67abf29899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f170af1b-1759-49a8-90da-16a5a6dac844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f170af1b-1759-49a8-90da-16a5a6dac844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-395281868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb64916f2574044a3ccbe5be3c19ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:05Z,use_quota=True,user_id='94d38dc78d0348229204b99322d75c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c7a1d3-c26b-4157-a0b5-ea8b31287732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c7a1d3-c26b-4157-a0b5-ea8b31287732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0da927-97f5-4254-b693-479ef5e454db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0da927-97f5-4254-b693-479ef5e454db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be', 'volume_name': 'volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5414ebff-911c-44f0-9e30-364e8301f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5414ebff-911c-44f0-9e30-364e8301f010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a50bd59-3a97-4bad-a380-f08b1ddb5f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be', 'volume_size': 1} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:04 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395" returned: 0 in 0.752s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.480s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Creating offline snapshot 161e7aa3-c7cd-42c0-9cbb-74ef4723a14b of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8c8b3-9971-48fd-a98e-8bb680f53f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e32d06-ad46-42b9-a1ef-016a61f60395', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff96512-73a6-4aad-b63d-b337b00158ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d0c7c3-6563-4256-98b3-df6ad8fa451b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:05 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Volume volume-94e32d06-ad46-42b9-a1ef-016a61f60395 (94e32d06-ad46-42b9-a1ef-016a61f60395): created successfully Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff96512-73a6-4aad-b63d-b337b00158ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Flow 'volume_create_manager' (ae79bc8b-3f6c-4327-8c22-1f3e8253791b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-4e9b1e84-7d40-4bf6-82ad-943d302e31a0 req-3133929c-685a-4587-b9ee-562952192003 tempest-VolumesGetTestJSON-250698908 None] Created volume successfully. Jun 23 16:01:05 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:05 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2906a043-7247-4ee1-8266-c3c45cb71203 tempest-BackendsCapabilitiesAdminTestsJSON-926998610 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.754566192627, 'free_capacity_gb': 1775.754566192627, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93590) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Acquiring lock "cinder-94e32d06-ad46-42b9-a1ef-016a61f60395-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "cinder-94e32d06-ad46-42b9-a1ef-016a61f60395-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Acquiring lock "cinder-quobyte-94e32d06-ad46-42b9-a1ef-016a61f60395" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "cinder-quobyte-94e32d06-ad46-42b9-a1ef-016a61f60395" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ef925-e7bb-41ea-9677-15bb5e44d2df]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:05 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:05 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:06 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 Jun 23 16:01:06 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:06 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 1.034s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:06 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b 1G Jun 23 16:01:06 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:06 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.988s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:01:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:01:07 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395" returned: 0 in 1.170s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:07 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395 Jun 23 16:01:07 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:07 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b 1G" returned: 0 in 1.264s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:07 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:07 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:07 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-94e32d06-ad46-42b9-a1ef-016a61f60395" returned: 0 in 0.798s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "cinder-quobyte-94e32d06-ad46-42b9-a1ef-016a61f60395" released by "delete_volume" :: held 2.039s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:07 devstack cinder-volume[93590]: DEBUG cinder.quota [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Created reservations ['ddf3bac4-d86d-41c0-bd0c-d28ce27f8617', '64764504-2da4-4082-b4a8-730698fb1c35', '50d533aa-237f-4fe1-8133-66bc052e5b14', '2d393900-5cd8-460b-9430-707c58215b6d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:08 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:08 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:08 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 1.144s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:08 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b is being set with open permissions: ugo+rw Jun 23 16:01:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:08 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:08 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:09 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.942s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.manager [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Deleted volume successfully. Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-bd54c797-2da8-42af-8115-91f09fcac0e2 req-b2e0ecbe-d12d-4b2c-a1a1-cab3f981cb5c tempest-VolumesGetTestJSON-250698908 None] Lock "cinder-94e32d06-ad46-42b9-a1ef-016a61f60395-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 1.323s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:09 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.935s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.410s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-347175157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9880c3be-3c53-4b3e-8abc-6cf228e3789a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb64916f2574044a3ccbe5be3c19ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:04Z,use_quota=True,user_id='94d38dc78d0348229204b99322d75c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Creating volume 9880c3be-3c53-4b3e-8abc-6cf228e3789a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:09 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:09 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a 1073741824 Jun 23 16:01:09 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-924e9663-cdb8-4b51-97c0-772a19a866da tempest-VolumesSnapshotListTestJSON-871008156 None] Create snapshot completed successfully Jun 23 16:01:10 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a 1073741824" returned: 0 in 1.065s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:11 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a Jun 23 16:01:11 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:11 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a" returned: 0 in 0.752s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.946s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-395281868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb64916f2574044a3ccbe5be3c19ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:05Z,use_quota=True,user_id='94d38dc78d0348229204b99322d75c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Creating volume bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:11 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:11 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be 1073741824 Jun 23 16:01:11 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae42cb1f-da96-4797-98ac-ccf94c96d938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b0c96-4c79-456a-9d0d-791da6b99ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a (9880c3be-3c53-4b3e-8abc-6cf228e3789a): created successfully Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b0c96-4c79-456a-9d0d-791da6b99ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Flow 'volume_create_manager' (cc4b0025-94ec-4ee3-abf4-15ad78bae239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bb924209-adf6-466b-ba77-563fd11b51ea tempest-TestServerVolumeAttachmentScenario-1638096414 None] Created volume successfully. Jun 23 16:01:12 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be 1073741824" returned: 0 in 1.088s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:12 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be Jun 23 16:01:12 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9e41b23f-86c2-4d0d-a82a-5cca1087e485 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1542164401: creating Jun 23 16:01:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9e41b23f-86c2-4d0d-a82a-5cca1087e485 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1542164401: created successfully Jun 23 16:01:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9e41b23f-86c2-4d0d-a82a-5cca1087e485 tempest-GroupSnapshotsTest-2140141254 None] Create group completed successfully. Jun 23 16:01:13 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" returned: 0 in 0.734s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.357s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Creating offline snapshot de44640a-1f37-4f09-bade-88b6e1d5da05 of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a50bd59-3a97-4bad-a380-f08b1ddb5f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5d6c7-14eb-4425-a81b-ca244c6063d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adfe616-7a7b-4168-ba27-bb1e496043bf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Volume volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be (bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be): created successfully Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f5d6c7-14eb-4425-a81b-ca244c6063d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Flow 'volume_create_manager' (a380fc3e-ea3e-4f59-bb9e-4d67abf29899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-70ee4a7b-1f7e-4ca7-91f0-7403657c5bec tempest-TestServerVolumeAttachmentScenario-1638096414 None] Created volume successfully. Jun 23 16:01:13 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:13 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:14 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:14 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 1G Jun 23 16:01:14 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (37925c17-3045-4a5d-a489-eb534da35981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d30885-d011-435d-ae46-bc2fb161ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d30885-d011-435d-ae46-bc2fb161ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240652033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d5863c9-385b-4672-afde-367df8ab7d9d,host='devstack@QuobyteHD#QuobyteHD',id=e4928081-d631-4ab2-adf3-4cadd7078570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:15Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cec24f-58f8-4e5e-80d7-b4142fc7bd31),volume_type_id=a1cec24f-58f8-4e5e-80d7-b4142fc7bd31)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1f587d-c555-4777-9128-2d7a43b87749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1f587d-c555-4777-9128-2d7a43b87749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852d0565-8dc4-4a64-a027-56e6e9cb5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852d0565-8dc4-4a64-a027-56e6e9cb5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4928081-d631-4ab2-adf3-4cadd7078570', 'volume_name': 'volume-e4928081-d631-4ab2-adf3-4cadd7078570', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d5b25d-2c1a-4f0a-ae18-45f8149227cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d5b25d-2c1a-4f0a-ae18-45f8149227cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0b6c75-5f5c-416a-9977-4093f66c8260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Volume e4928081-d631-4ab2-adf3-4cadd7078570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4928081-d631-4ab2-adf3-4cadd7078570', 'volume_size': 1} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:15 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 1G" returned: 0 in 1.315s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:15 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 Jun 23 16:01:15 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:16 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05" returned: 0 in 0.925s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:16 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 is being set with open permissions: ugo+rw Jun 23 16:01:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:16 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 Jun 23 16:01:16 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:17 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05" returned: 0 in 0.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d5863c9-385b-4672-afde-367df8ab7d9d,created_at=2026-06-23T14:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240652033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d5863c9-385b-4672-afde-367df8ab7d9d,host='devstack@QuobyteHD#QuobyteHD',id=e4928081-d631-4ab2-adf3-4cadd7078570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:15Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cec24f-58f8-4e5e-80d7-b4142fc7bd31),volume_type_id=a1cec24f-58f8-4e5e-80d7-b4142fc7bd31)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Creating volume e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:17 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:17 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 1073741824 Jun 23 16:01:17 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3e900982-44cb-44a2-961f-9543333450fc tempest-VolumesSnapshotListTestJSON-871008156 None] Create snapshot completed successfully Jun 23 16:01:18 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 1073741824" returned: 0 in 0.906s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:18 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:18 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:19 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.898s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0b6c75-5f5c-416a-9977-4093f66c8260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4928081-d631-4ab2-adf3-4cadd7078570', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccbc04-f4fd-4b6e-aaae-8d16d37d28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:19 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Volume volume-e4928081-d631-4ab2-adf3-4cadd7078570 (e4928081-d631-4ab2-adf3-4cadd7078570): created successfully Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dccbc04-f4fd-4b6e-aaae-8d16d37d28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (37925c17-3045-4a5d-a489-eb534da35981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-69616124-d936-4530-8751-b8642a3831e6 tempest-GroupSnapshotsTest-2140141254 None] Created volume successfully. Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-de44640a-1f37-4f09-bade-88b6e1d5da05-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-de44640a-1f37-4f09-bade-88b6e1d5da05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-de44640a-1f37-4f09-bade-88b6e1d5da05" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-de44640a-1f37-4f09-bade-88b6e1d5da05" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Deleting offline snapshot de44640a-1f37-4f09-bade-88b6e1d5da05 of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] snapshot_file for this snap is: volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac264d-6608-4415-aa57-c8be3f9ea925]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:19 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 Jun 23 16:01:19 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:20 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05" returned: 0 in 0.890s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee471fce-354e-4ea1-a715-4e9e9f3e489a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:20 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:20 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] GroupSnapshot a7dd2980-866a-4b35-9089-ec336389fd41: creating. Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Group snapshot a7dd2980-866a-4b35-9089-ec336389fd41: creating. {{(pid=93590) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Creating offline snapshot 6717cad2-45f6-461a-8b3e-618fc61a2831 of volume e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a4ed05-3a73-46b2-82df-c1a2a08e2893]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:21 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:21 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=89,cinder:INSERT=29,cinder:UPDATE=112,cinder:DELETE=11 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=108,cinder:SELECT=89,cinder:INSERT=24,cinder:DELETE=9 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:21 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Flow 'volume_create_manager' (2b124bc7-5310-498b-9079-3b575da5b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d25352f-144c-4dc9-a544-32b3a8a78173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d25352f-144c-4dc9-a544-32b3a8a78173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-52570794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c59c0ff755e457f9a29e6f779cabdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:21Z,use_quota=True,user_id='7965edf67b2146f89345fb3601f9180c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:21 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 Jun 23 16:01:21 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3179b96c-6917-43ba-aa01-0ad33238ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3179b96c-6917-43ba-aa01-0ad33238ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2045a2f1-039c-430f-bd5e-42d84b72b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2045a2f1-039c-430f-bd5e-42d84b72b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab', 'volume_name': 'volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12014d9e-c4a3-4e32-8fb8-9fd433ed590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12014d9e-c4a3-4e32-8fb8-9fd433ed590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5446c7bf-9453-4732-9a86-0177d0eec323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume 2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab', 'volume_size': 1} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:21 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.899s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:21 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 1G Jun 23 16:01:21 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:22 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05" returned: 0 in 0.831s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:22 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05 Jun 23 16:01:22 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:22 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 1G" returned: 0 in 0.825s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4928081-d631-4ab2-adf3-4cadd7078570 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:22 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4928081-d631-4ab2-adf3-4cadd7078570 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:22 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:23 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.de44640a-1f37-4f09-bade-88b6e1d5da05" returned: 0 in 0.692s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-de44640a-1f37-4f09-bade-88b6e1d5da05" released by "_delete_snapshot" :: held 3.397s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" released by "delete_snapshot" :: held 3.429s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Created reservations ['46ec52e9-9b42-4f68-a8d9-dc5ffd08cdd3', '5c0e1618-a675-44ef-9fae-e5b7e75e51ed', '07050499-79dc-4ff7-abd0-4eb218db8eec', '447c855c-6d38-44c8-a1aa-5093931495bf'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Delete snapshot completed successfully. Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cfc36a1b-f84f-4aba-bc16-8d9abe28c552 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-de44640a-1f37-4f09-bade-88b6e1d5da05-delete_snapshot" released by "delete_snapshot" :: held 3.697s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:23 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4928081-d631-4ab2-adf3-4cadd7078570 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 1.082s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:23 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:01:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:23 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:23 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Deleting offline snapshot 161e7aa3-c7cd-42c0-9cbb-74ef4723a14b of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] snapshot_file for this snap is: volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b7b6e-0a18-4f5b-951d-884d12faeff8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:24 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:24 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:24 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:24 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info Jun 23 16:01:24 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:25 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 0.813s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86cc10c-8a0c-4e14-8784-5995e5ab5701]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:25 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:25 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:25 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info" returned: 0 in 0.761s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:25 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:01:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:25 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info Jun 23 16:01:25 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:26 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 1.006s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:26 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:26 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:26 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.info" returned: 0 in 0.839s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.471s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.847s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-52570794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c59c0ff755e457f9a29e6f779cabdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:21Z,use_quota=True,user_id='7965edf67b2146f89345fb3601f9180c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Creating volume 2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:26 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:26 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab 1073741824 Jun 23 16:01:26 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7943ec24-6ddd-4dae-8a82-e5d071a230e0 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot a7dd2980-866a-4b35-9089-ec336389fd41: created successfully Jun 23 16:01:27 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:27 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b Jun 23 16:01:27 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:27 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab 1073741824" returned: 0 in 1.109s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:27 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab Jun 23 16:01:27 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:28 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" returned: 0 in 0.924s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b" released by "_delete_snapshot" :: held 3.779s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" released by "delete_snapshot" :: held 3.840s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Created reservations ['7cc48e42-4f42-467c-ad8a-1ff88a4c2dc6', '6980b326-6766-4b2f-9cf6-30561ebdeead', '727744fc-3426-4b1a-aad8-9df404436786', 'ee50bcd4-7656-4acc-86ce-a0e8ab243db5'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Delete snapshot completed successfully. Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-756f7428-1f76-4dee-a0a5-d3e9d0491a47 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-161e7aa3-c7cd-42c0-9cbb-74ef4723a14b-delete_snapshot" released by "delete_snapshot" :: held 4.021s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:28 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-7209ff52-f9a3-4c12-a70d-2e7ecd777a18-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" returned: 0 in 0.949s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-7209ff52-f9a3-4c12-a70d-2e7ecd777a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5446c7bf-9453-4732-9a86-0177d0eec323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdb1122-25f5-47e6-a990-ec78ebc69c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-7209ff52-f9a3-4c12-a70d-2e7ecd777a18" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:28 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab (2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab): created successfully Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdb1122-25f5-47e6-a990-ec78ebc69c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Flow 'volume_create_manager' (2b124bc7-5310-498b-9079-3b575da5b42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-7209ff52-f9a3-4c12-a70d-2e7ecd777a18" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Deleting offline snapshot 7209ff52-f9a3-4c12-a70d-2e7ecd777a18 of volume 8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] snapshot_file for this snap is: volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e79452-c90c-46bf-9622-27d7055f90ca]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2825e542-e29d-40f6-a821-7f5ce13e911e tempest-VolumeQuotasAdminTestJSON-890776738 None] Created volume successfully. Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:28 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:28 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Creating volume d49c44e7-55c1-48cb-b62b-caf250a2c1c7 from snapshot 6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] snapshot: 6717cad2-45f6-461a-8b3e-618fc61a2831, volume: d49c44e7-55c1-48cb-b62b-caf250a2c1c7, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ab84a-a683-4418-b69a-1148ee3ac12c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "cinder-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:29 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:29 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "cinder-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "cinder-quobyte-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "cinder-quobyte-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" acquired by "delete_volume" :: waited 0.035s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac1668-4d57-4011-9048-b63c6ee75d07]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:29 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab Jun 23 16:01:29 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:29 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 1.160s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c11c712-1e9f-4ce7-931c-283282aedaf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[def9a1ec-27e3-45eb-8f63-9885cc3adb9b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:30 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 Jun 23 16:01:30 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:30 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 1.284s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4928081-d631-4ab2-adf3-4cadd7078570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[af078aa0-9dda-4f9f-9dda-49e097db18a5]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:30 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:30 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:30 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" returned: 0 in 1.269s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:30 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab Jun 23 16:01:30 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:31 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0" returned: 0 in 1.053s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:31 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:31 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:31 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:31 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 Jun 23 16:01:31 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:31 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" returned: 0 in 0.769s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "cinder-quobyte-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab" released by "delete_volume" :: held 2.084s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Created reservations ['58c7aa7c-c770-4e5e-bd05-9857101cb9a4', '927750ac-0e85-4b7b-9d50-37b4f32d94dd', '6e346836-2b4e-48f3-a69f-55a781234668', '424aa177-d748-4390-8460-771ae13ab424'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:31 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:31 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:32 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 1.016s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:32 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18 Jun 23 16:01:32 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:33 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0.7209ff52-f9a3-4c12-a70d-2e7ecd777a18" returned: 0 in 1.358s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:33 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-7209ff52-f9a3-4c12-a70d-2e7ecd777a18" released by "_delete_snapshot" :: held 4.916s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.767s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" released by "delete_snapshot" :: held 5.026s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Deleted volume successfully. Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab19fa54-ee0f-46cf-bcaf-24838031e0ac tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "cinder-2b7c5ef6-c4f2-401b-9d0e-097bfccc01ab-delete_volume" released by "delete_volume" :: held 4.402s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:33 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Created reservations ['350473b4-18c3-4153-a228-74e442023b70', 'bec1883a-3572-47db-912d-d7d088866da8', '2c7cb8de-1881-4e56-8883-2343b886ef66', '252205e1-005a-457e-96ef-dbc14ccde11b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Delete snapshot completed successfully. Jun 23 16:01:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-59299362-e90d-4ef4-b506-588ca1bd2e1b tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-7209ff52-f9a3-4c12-a70d-2e7ecd777a18-delete_snapshot" released by "delete_snapshot" :: held 5.736s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Flow 'volume_create_manager' (c160e664-89cb-4fb7-9d22-e113937f8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3be47d-1f88-4c2f-9c03-980edc687617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3be47d-1f88-4c2f-9c03-980edc687617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-347514093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008a50b-8ad6-4ed4-94d5-707df2696f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c59c0ff755e457f9a29e6f779cabdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:35Z,use_quota=True,user_id='7965edf67b2146f89345fb3601f9180c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1a8575-02f4-4b7d-95af-f6542f3f7bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1a8575-02f4-4b7d-95af-f6542f3f7bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537c8b3b-8b8a-49ee-a0d0-9c24b6ec147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537c8b3b-8b8a-49ee-a0d0-9c24b6ec147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8008a50b-8ad6-4ed4-94d5-707df2696f63', 'volume_name': 'volume-8008a50b-8ad6-4ed4-94d5-707df2696f63', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91d6fd0-08fd-494d-861d-b313ad9d3380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91d6fd0-08fd-494d-861d-b313ad9d3380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb3e1ec-f87f-4e19-aeeb-00a2202500fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:35 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume 8008a50b-8ad6-4ed4-94d5-707df2696f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8008a50b-8ad6-4ed4-94d5-707df2696f63', 'volume_size': 1} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-8c11c712-1e9f-4ce7-931c-283282aedaf0-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-8c11c712-1e9f-4ce7-931c-283282aedaf0-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" acquired by "delete_volume" :: waited 0.052s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a020c708-68bc-4b6b-96cf-620e6d90277f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:36 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 Jun 23 16:01:36 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:38 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0" returned: 0 in 2.252s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:38 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0 Jun 23 16:01:38 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:38 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" returned: 0 in 7.009s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db356d-0ea1-45f7-a7f7-6118b66682c6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:38 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:38 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:38 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c11c712-1e9f-4ce7-931c-283282aedaf0" returned: 0 in 0.718s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-quobyte-8c11c712-1e9f-4ce7-931c-283282aedaf0" released by "delete_volume" :: held 3.138s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Created reservations ['381721d8-b157-45e5-9385-5f95dffd4a51', '3b9a1997-8e34-489e-b57f-1d8747051684', 'aee5f817-7a61-4ac1-b1f4-34a1b58df355', '22e6cc9a-1d1e-455a-b116-36bacc7f16d8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:39 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:39 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:39 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.961s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:01:39 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Converted 1024.00 MB image at 146.08 MB/s Jun 23 16:01:39 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:39 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 Jun 23 16:01:39 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:39 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.686s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Deleted volume successfully. Jun 23 16:01:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b650e729-3997-4ccb-9e9b-519b828d75c5 tempest-VolumesSnapshotListTestJSON-871008156 None] Lock "cinder-8c11c712-1e9f-4ce7-931c-283282aedaf0-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:40 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" returned: 0 in 0.665s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" released by "_copy_volume_from_snapshot" :: held 11.099s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" released by "_create_volume_from_snapshot" :: held 11.182s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.243s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.721s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-347514093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8008a50b-8ad6-4ed4-94d5-707df2696f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c59c0ff755e457f9a29e6f779cabdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:35Z,use_quota=True,user_id='7965edf67b2146f89345fb3601f9180c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Creating volume 8008a50b-8ad6-4ed4-94d5-707df2696f63 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:40 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:40 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 1073741824 Jun 23 16:01:40 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-28ffcb50-8fb0-44d4-9bbf-09b9d2b08b87 tempest-GroupSnapshotsTest-2140141254 None] Create group from source-snapshot-a7dd2980-866a-4b35-9089-ec336389fd41 completed successfully. Jun 23 16:01:41 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 1073741824" returned: 0 in 0.910s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:41 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 Jun 23 16:01:41 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[44069ee9-b612-4ad5-8a36-7d88ef60be41]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:41 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 Jun 23 16:01:41 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:41 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63" returned: 0 in 0.700s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb3e1ec-f87f-4e19-aeeb-00a2202500fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8008a50b-8ad6-4ed4-94d5-707df2696f63', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfc1147-152f-43a1-b75f-032112e78028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Volume volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 (8008a50b-8ad6-4ed4-94d5-707df2696f63): created successfully Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfc1147-152f-43a1-b75f-032112e78028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Flow 'volume_create_manager' (c160e664-89cb-4fb7-9d22-e113937f8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:41 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f03c07a1-4208-46f6-9f3d-8a0e9568e2c8 tempest-VolumeQuotasAdminTestJSON-890776738 None] Created volume successfully. Jun 23 16:01:42 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" returned: 0 in 0.833s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:42 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7 Jun 23 16:01:42 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:42 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" returned: 0 in 0.785s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-d49c44e7-55c1-48cb-b62b-caf250a2c1c7" released by "delete_volume" :: held 1.691s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['88ebb4f8-e095-4a6c-937a-8146704c2700'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:43 devstack cinder-volume[93590]: WARNING cinder.quota [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-144305705 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-144305705, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:01:43 devstack cinder-volume[93590]: WARNING cinder.quota [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-144305705 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-144305705, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['8669c5a4-0212-4772-b157-60c1d1dc2a08', 'ffa72531-c4e8-4abb-94ee-88f584cf3b10', 'eb7d5515-f7ad-4e9a-9549-9d9244933bb1', '951569ed-44f5-4f08-9490-5dd07fb43c0d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:43 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:43 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-21272b3c-91d5-49df-b210-c91c9a186316 tempest-VolumeQuotasAdminTestJSON-1506871279 None] Transfer volume completed successfully. Jun 23 16:01:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot a7dd2980-866a-4b35-9089-ec336389fd41: deleting Jun 23 16:01:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot a7dd2980-866a-4b35-9089-ec336389fd41: deleting {{(pid=93590) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Deleting offline snapshot 6717cad2-45f6-461a-8b3e-618fc61a2831 of volume e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] snapshot_file for this snap is: volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92447f4-a091-4f49-9d22-02329db34bad]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:44 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.898s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b027d396-2834-4725-9b6d-f11c6b62fad0 tempest-GroupSnapshotsTest-2140141254 None] Delete group completed successfully. Jun 23 16:01:44 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:44 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Acquiring lock "cinder-8008a50b-8ad6-4ed4-94d5-707df2696f63-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "cinder-8008a50b-8ad6-4ed4-94d5-707df2696f63-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Acquiring lock "cinder-quobyte-8008a50b-8ad6-4ed4-94d5-707df2696f63" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "cinder-quobyte-8008a50b-8ad6-4ed4-94d5-707df2696f63" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c220ba0-efeb-4a2f-a695-7283d28b44db]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:45 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 Jun 23 16:01:45 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:45 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 1.152s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4928081-d631-4ab2-adf3-4cadd7078570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a78b7fa-e88d-4c13-99f1-780a4a66015b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:45 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:45 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:45 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63" returned: 0 in 0.948s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:45 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63 Jun 23 16:01:45 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:46 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.950s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:46 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:46 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:46 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8008a50b-8ad6-4ed4-94d5-707df2696f63" returned: 0 in 0.745s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "cinder-quobyte-8008a50b-8ad6-4ed4-94d5-707df2696f63" released by "delete_volume" :: held 1.765s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Created reservations ['d275fd03-a331-4c81-b084-96e53aa0dda2', '7c852b30-16d8-4dae-b924-46a65d9348dc', '80dcaf21-919a-40e3-88d6-4f6f0faf5e67', 'b229f1a7-0c4d-45d7-ae04-dd02eb8ae2e2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:46 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:46 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:47 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 0.862s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:47 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831 Jun 23 16:01:47 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:47 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.743s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:47 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Deleted volume successfully. Jun 23 16:01:47 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fa3da3b2-f29d-41b9-9059-6e157e616ce2 tempest-VolumeQuotasAdminTestJSON-888786069 None] Lock "cinder-8008a50b-8ad6-4ed4-94d5-707df2696f63-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:48 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570.6717cad2-45f6-461a-8b3e-618fc61a2831" returned: 0 in 0.914s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6717cad2-45f6-461a-8b3e-618fc61a2831" released by "_delete_snapshot" :: held 4.042s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" released by "delete_snapshot" :: held 4.102s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:48 devstack cinder-volume[93590]: WARNING cinder.quota [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-144305705 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-144305705, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['79d43e24-9c17-430b-86e4-61515930ecee', '0cec05aa-794d-4d93-8df0-537e259b216d', '012a11a3-5836-499d-b95c-f93d45a03213', 'ea04b668-16da-4fe7-9571-331c0862dc0f'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7032c9f2-0ca9-410e-baf7-3fece9c3687c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot a7dd2980-866a-4b35-9089-ec336389fd41: deleted successfully Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc495ea-ff7c-4dfd-8ebd-72937e74d55d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:49 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:49 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:49 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:49 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570 Jun 23 16:01:49 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:50 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e4928081-d631-4ab2-adf3-4cadd7078570" returned: 0 in 0.902s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-e4928081-d631-4ab2-adf3-4cadd7078570" released by "delete_volume" :: held 2.002s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:01:50 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['5fb5f8c5-f5a4-475d-af92-1ef57205cabd'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:51 devstack cinder-volume[93590]: WARNING cinder.db.api [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-144305705'] Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['499bf74b-57ba-40c9-b871-f8eccda94eaf', 'c365d021-ed0f-4b53-b736-328dd3eae786', '763f850c-70e8-4cbb-8c29-463780be2fc7', 'b86b7401-d393-45d2-be95-cd39f2198c70'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:51 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:01:51 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:51 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-375240c7-40a8-4aed-9d9f-783b347a4db7 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1093676715: creating Jun 23 16:01:51 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-375240c7-40a8-4aed-9d9f-783b347a4db7 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1093676715: created successfully Jun 23 16:01:51 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-375240c7-40a8-4aed-9d9f-783b347a4db7 tempest-GroupSnapshotsTest-2140141254 None] Create group completed successfully. Jun 23 16:01:52 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.041s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:52 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:01:52 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2f7cc70e-4087-4a32-978a-9c9c5225f261 tempest-GroupSnapshotsTest-2140141254 None] Delete group completed successfully. Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (c127be2b-c80d-427a-a878-6d27623d0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe350539-da3c-4e07-a0e3-afa57701e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe350539-da3c-4e07-a0e3-afa57701e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951212408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40e96c9-727b-47d2-a80f-5bef496781d2,host='devstack@QuobyteHD#QuobyteHD',id=2840c3e7-80c7-428c-89d7-28327d8c314c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:54Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bec320-62f0-4506-82ed-aee7816851c0),volume_type_id=01bec320-62f0-4506-82ed-aee7816851c0)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd1d68-5658-4cef-8b4a-c8e68c66912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd1d68-5658-4cef-8b4a-c8e68c66912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5eb145-0192-472e-a144-fda04b3fb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5eb145-0192-472e-a144-fda04b3fb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2840c3e7-80c7-428c-89d7-28327d8c314c', 'volume_name': 'volume-2840c3e7-80c7-428c-89d7-28327d8c314c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151f39b4-ff30-4631-ae83-add2943f11dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151f39b4-ff30-4631-ae83-add2943f11dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ad5dc2-bce6-420d-ba04-0453039aa45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Volume 2840c3e7-80c7-428c-89d7-28327d8c314c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2840c3e7-80c7-428c-89d7-28327d8c314c', 'volume_size': 1} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a40e96c9-727b-47d2-a80f-5bef496781d2,created_at=2026-06-23T14:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951212408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40e96c9-727b-47d2-a80f-5bef496781d2,host='devstack@QuobyteHD#QuobyteHD',id=2840c3e7-80c7-428c-89d7-28327d8c314c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:54Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bec320-62f0-4506-82ed-aee7816851c0),volume_type_id=01bec320-62f0-4506-82ed-aee7816851c0)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Creating volume 2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:53 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c 1073741824 Jun 23 16:01:53 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:55 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c 1073741824" returned: 0 in 1.174s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:55 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c Jun 23 16:01:55 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:55 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c" returned: 0 in 0.847s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.894s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ad5dc2-bce6-420d-ba04-0453039aa45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2840c3e7-80c7-428c-89d7-28327d8c314c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad8e95-5800-4928-8794-4aba82d69c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:55 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b058790-b74e-4fe2-93fc-2a39ae981791]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Volume volume-2840c3e7-80c7-428c-89d7-28327d8c314c (2840c3e7-80c7-428c-89d7-28327d8c314c): created successfully Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad8e95-5800-4928-8794-4aba82d69c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (c127be2b-c80d-427a-a878-6d27623d0b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f10f1e30-c0f4-4421-9062-9d2c5b8cadf7 tempest-GroupSnapshotsTest-2140141254 None] Created volume successfully. Jun 23 16:01:56 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a Jun 23 16:01:56 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:56 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (c9415cfd-7543-470e-9629-7aa2ec068857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61f20a-f3a4-44f1-b82e-c2867386d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac61f20a-f3a4-44f1-b82e-c2867386d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047740817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40e96c9-727b-47d2-a80f-5bef496781d2,host='devstack@QuobyteHD#QuobyteHD',id=6bcc1f59-8e91-4117-9581-f7abf81a3a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:57Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bec320-62f0-4506-82ed-aee7816851c0),volume_type_id=01bec320-62f0-4506-82ed-aee7816851c0)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cdfe7c-d8a5-47ec-9559-c14a5b9fe62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cdfe7c-d8a5-47ec-9559-c14a5b9fe62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95de22e-9620-49ba-8589-5457af27eed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95de22e-9620-49ba-8589-5457af27eed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcc1f59-8e91-4117-9581-f7abf81a3a28', 'volume_name': 'volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f1e0f7-f26c-4eca-bf4b-0df4be3fe92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f1e0f7-f26c-4eca-bf4b-0df4be3fe92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c926c1-5a32-4006-9fe4-944cc3a22c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:57 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Volume 6bcc1f59-8e91-4117-9581-f7abf81a3a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28', 'volume_size': 1} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a40e96c9-727b-47d2-a80f-5bef496781d2,created_at=2026-06-23T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1047740817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a40e96c9-727b-47d2-a80f-5bef496781d2,host='devstack@QuobyteHD#QuobyteHD',id=6bcc1f59-8e91-4117-9581-f7abf81a3a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:57Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bec320-62f0-4506-82ed-aee7816851c0),volume_type_id=01bec320-62f0-4506-82ed-aee7816851c0)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Creating volume 6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:57 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:57 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 1073741824 Jun 23 16:01:57 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '495726c5-a1d2-4354-af9a-163aaa843751', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:01:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-6c9c7f24-d116-4e09-9ebc-b0658e75556f req-3e730c13-d5fe-4120-b9a5-da54e5dfd850 tempest-TestServerVolumeAttachmentScenario-1638096414 None] attachment_update completed successfully. Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Flow 'volume_create_manager' (b49fb48f-abd9-47c4-8b99-d027792c2e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771bc265-cf70-4aa6-bbad-8197bec0ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:58 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 1073741824" returned: 0 in 1.249s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771bc265-cf70-4aa6-bbad-8197bec0ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1806559868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388580c6-abdd-4313-bc35-8c3bc4983b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51be7dd1e1264108b8e0bd3094d69739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:58Z,use_quota=True,user_id='c9c0120b10824be9a028073a38e15cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8d9b32-8bae-4e32-94d6-448b78eaaf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8d9b32-8bae-4e32-94d6-448b78eaaf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e5e8a-d90e-480b-b8d4-bed09fcdd7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00e5e8a-d90e-480b-b8d4-bed09fcdd7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388580c6-abdd-4313-bc35-8c3bc4983b51', 'volume_name': 'volume-388580c6-abdd-4313-bc35-8c3bc4983b51', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab97da66-97ee-47a4-b7cf-5d63ee47578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab97da66-97ee-47a4-b7cf-5d63ee47578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736adff0-d4b8-4764-8a83-c85a49a905e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Volume 388580c6-abdd-4313-bc35-8c3bc4983b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388580c6-abdd-4313-bc35-8c3bc4983b51', 'volume_size': 1} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:58 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 Jun 23 16:01:58 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:59 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28" returned: 0 in 0.751s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1806559868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388580c6-abdd-4313-bc35-8c3bc4983b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51be7dd1e1264108b8e0bd3094d69739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:01:58Z,use_quota=True,user_id='c9c0120b10824be9a028073a38e15cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Creating volume 388580c6-abdd-4313-bc35-8c3bc4983b51 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:01:59 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:01:59 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 1073741824 Jun 23 16:01:59 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c926c1-5a32-4006-9fe4-944cc3a22c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d6021-ece9-43b5-a7b8-85534a171e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:01:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Volume volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 (6bcc1f59-8e91-4117-9581-f7abf81a3a28): created successfully Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d6021-ece9-43b5-a7b8-85534a171e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:01:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (c9415cfd-7543-470e-9629-7aa2ec068857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:01:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8cee4415-d7e9-49ac-a71c-b425a2573722 tempest-GroupSnapshotsTest-2140141254 None] Created volume successfully. Jun 23 16:01:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-832b4516-c9ec-4f39-93ed-506518c87747 tempest-GroupSnapshotsTest-2140141254 None] Update group completed successfully. Jun 23 16:02:00 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 1073741824" returned: 0 in 0.960s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:00 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 Jun 23 16:02:00 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-91c20715-ef13-42cd-a4cd-a97d86914fa4 tempest-GroupSnapshotsTest-2140141254 None] Update group completed successfully. Jun 23 16:02:01 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51" returned: 0 in 0.844s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736adff0-d4b8-4764-8a83-c85a49a905e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388580c6-abdd-4313-bc35-8c3bc4983b51', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c02cb82-fe85-438f-b47a-3c8081b80094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:01 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Volume volume-388580c6-abdd-4313-bc35-8c3bc4983b51 (388580c6-abdd-4313-bc35-8c3bc4983b51): created successfully Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c02cb82-fe85-438f-b47a-3c8081b80094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Flow 'volume_create_manager' (b49fb48f-abd9-47c4-8b99-d027792c2e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bc1c688a-288b-4f01-a61e-495f8c00840e tempest-VolumesServicesTestJSON-103617522 None] Created volume successfully. Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Acquiring lock "cinder-388580c6-abdd-4313-bc35-8c3bc4983b51-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "cinder-388580c6-abdd-4313-bc35-8c3bc4983b51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Acquiring lock "cinder-quobyte-388580c6-abdd-4313-bc35-8c3bc4983b51" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "cinder-quobyte-388580c6-abdd-4313-bc35-8c3bc4983b51" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d545f0b1-6248-4ba5-9647-7a15ca9d2f47]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:01 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 Jun 23 16:02:01 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f12a3fa8-dde0-4979-9f55-51e8196b5972 tempest-GroupSnapshotsTest-2140141254 None] Update group completed successfully. Jun 23 16:02:02 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51" returned: 0 in 1.033s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:02 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51 Jun 23 16:02:02 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a8fb607f-d77a-41f4-bf54-1f896215aeb6 tempest-GroupSnapshotsTest-2140141254 None] Update group completed successfully. Jun 23 16:02:03 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-388580c6-abdd-4313-bc35-8c3bc4983b51" returned: 0 in 0.849s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "cinder-quobyte-388580c6-abdd-4313-bc35-8c3bc4983b51" released by "delete_volume" :: held 1.957s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Created reservations ['35bca5a0-bbf8-453b-8dbd-659eea47eb9d', 'bef58142-a81d-46e1-97b0-0e56e846d2fa', '736fe7b0-bb15-4382-a358-4b5e4ef8fb3c', 'f6734710-c7b4-4503-9065-81fe80be1569'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:03 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:03 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:04 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.830s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Deleted volume successfully. Jun 23 16:02:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a070f847-3977-4226-a3de-99299c913c25 tempest-VolumesServicesTestJSON-103617522 None] Lock "cinder-388580c6-abdd-4313-bc35-8c3bc4983b51-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] GroupSnapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: creating. Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Group snapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: creating. {{(pid=93590) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Creating offline snapshot 797cda71-02d6-4815-84ff-18e0e669998b of volume 2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee68d74-ab5f-4e58-9699-f602db67bfdf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:05 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c Jun 23 16:02:05 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:05 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:05 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:06 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c" returned: 0 in 1.257s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:06 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b 1G Jun 23 16:02:06 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:06 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.023s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:02:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:02:08 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b 1G" returned: 0 in 1.237s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2840c3e7-80c7-428c-89d7-28327d8c314c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:08 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2840c3e7-80c7-428c-89d7-28327d8c314c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b Jun 23 16:02:08 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:08 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2840c3e7-80c7-428c-89d7-28327d8c314c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b" returned: 0 in 0.801s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:08 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:08 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b Jun 23 16:02:08 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:09 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b" returned: 0 in 1.033s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:10 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info Jun 23 16:02:10 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (69bd8e75-95ad-486e-9cda-4248e9b5ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a14d2-ea49-4dc7-a915-53d554b98e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:10 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info" returned: 0 in 0.764s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:10 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a14d2-ea49-4dc7-a915-53d554b98e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1277005379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689f31e0-e362-456b-9a95-72723b358031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:11Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfbcf0c7-313b-4d5a-a02e-60b3d96342cd),volume_type_id=bfbcf0c7-313b-4d5a-a02e-60b3d96342cd)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:10 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info Jun 23 16:02:10 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bf567-542c-4cfa-973c-61f37b67a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510bf567-542c-4cfa-973c-61f37b67a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc4aac-c35e-4a6d-8423-f57ac45c083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dc4aac-c35e-4a6d-8423-f57ac45c083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689f31e0-e362-456b-9a95-72723b358031', 'volume_name': 'volume-689f31e0-e362-456b-9a95-72723b358031', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee968a9-1461-4440-a57a-d5bb6b52f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee968a9-1461-4440-a57a-d5bb6b52f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c6644c-cebd-4504-9630-f9cc0d7c1a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Volume 689f31e0-e362-456b-9a95-72723b358031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689f31e0-e362-456b-9a95-72723b358031', 'volume_size': 1} Jun 23 16:02:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (e0eba269-c414-4346-bc69-5ba260117e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61053ea0-0125-4ce4-aff5-354d94ddb0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61053ea0-0125-4ce4-aff5-354d94ddb0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1659355696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff6da06-8237-46c7-9c38-d1b81a4cd455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:11Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17204fbc-0d4a-4a24-80d3-af4fd2dd78d8),volume_type_id=17204fbc-0d4a-4a24-80d3-af4fd2dd78d8)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b19b5f2-e248-47eb-b47b-e95b5689d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b19b5f2-e248-47eb-b47b-e95b5689d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb938ff5-c2cc-4006-ac0c-a3b5b1c32782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb938ff5-c2cc-4006-ac0c-a3b5b1c32782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff6da06-8237-46c7-9c38-d1b81a4cd455', 'volume_name': 'volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4264776-6f95-4be1-8226-b08d67f6f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4264776-6f95-4be1-8226-b08d67f6f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63afcd1e-3cab-4ea3-a912-291a30ba40f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Volume 2ff6da06-8237-46c7-9c38-d1b81a4cd455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455', 'volume_size': 1} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:11 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.info" returned: 0 in 0.791s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.029s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Creating offline snapshot a50d778c-95bf-451f-9cbc-30ba2718ad0a of volume 6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768fbb5-c32f-4bc3-b442-b139412c2bd0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:11 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 Jun 23 16:02:11 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (425705fb-b0fc-4c28-9e35-e48cae4d3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95fc43-f04d-4eab-a8f7-c62215418908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea95fc43-f04d-4eab-a8f7-c62215418908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218185189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19e45f6-1640-4db6-9a88-1a2266bbf6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:12Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244510d6-0fee-4cb5-a008-f0c4b31c67b0),volume_type_id=244510d6-0fee-4cb5-a008-f0c4b31c67b0)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe627b-eb26-4758-aade-bbf1fdcbb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe627b-eb26-4758-aade-bbf1fdcbb722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03e7ac7-3817-4b44-8b1f-ad57d1d4ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:02:12 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28" returned: 0 in 0.849s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:12 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a 1G Jun 23 16:02:12 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Flow 'volume_create_manager' (807cabd8-f80e-48cb-8856-fdbb86f18cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beb1383-9dba-4c2e-94b5-db7435b46c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beb1383-9dba-4c2e-94b5-db7435b46c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-414451533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5eb646-68e2-43d0-9596-09930c4a446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc42e2a5e1d45f8ba2078416dded22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:13Z,use_quota=True,user_id='ee93904777054c8ebd87f2622e9f5369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40162a1c-d60d-4164-8d69-d50503556d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40162a1c-d60d-4164-8d69-d50503556d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571c0053-78b7-42c2-bb24-c4bfa5f41115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571c0053-78b7-42c2-bb24-c4bfa5f41115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5eb646-68e2-43d0-9596-09930c4a446a', 'volume_name': 'volume-1b5eb646-68e2-43d0-9596-09930c4a446a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a006a519-5887-457a-a608-c96b1886e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a006a519-5887-457a-a608-c96b1886e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cd009e-c3f1-484a-8541-37e35c3f6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Volume 1b5eb646-68e2-43d0-9596-09930c4a446a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5eb646-68e2-43d0-9596-09930c4a446a', 'volume_size': 1} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03e7ac7-3817-4b44-8b1f-ad57d1d4ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd19e45f6-1640-4db6-9a88-1a2266bbf6a3', 'volume_name': 'volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3', 'volume_size': 1, 'image_id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--628732716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72ba26b104144b82bbc047358e672839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'created_at': datetime.datetime(2026, 6, 23, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/016c4826-d5ee-4472-85c7-0a7c6c905863/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05fe1cd-7b1a-4f03-a11b-400531a4aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05fe1cd-7b1a-4f03-a11b-400531a4aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441f688d-0493-4a5c-a64e-f6198180bfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:12 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3', 'volume_size': 1, 'image_id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--628732716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72ba26b104144b82bbc047358e672839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'created_at': datetime.datetime(2026, 6, 23, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/016c4826-d5ee-4472-85c7-0a7c6c905863/file', 'properties': {}}, 'image_service': } Jun 23 16:02:12 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Trying to clone d19e45f6-1640-4db6-9a88-1a2266bbf6a3 from image 016c4826-d5ee-4472-85c7-0a7c6c905863 at location (None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:02:13 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a 1G" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:13 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a Jun 23 16:02:13 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:14 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a" returned: 0 in 0.830s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:14 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:14 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a Jun 23 16:02:14 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:14 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a" returned: 0 in 0.712s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:14 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info Jun 23 16:02:14 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:15 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info" returned: 0 in 0.635s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:15 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:15 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info Jun 23 16:02:15 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:15 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD, size 20.69 MB, duration 3.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:02:15 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Image download 20.69 MB at 6.91 MB/s Jun 23 16:02:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731dc50-fd10-4dd3-beb4-78f8c54e4b30]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:16 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD Jun 23 16:02:16 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:16 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.info" returned: 0 in 0.652s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.639s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.377s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1277005379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689f31e0-e362-456b-9a95-72723b358031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:11Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfbcf0c7-313b-4d5a-a02e-60b3d96342cd),volume_type_id=bfbcf0c7-313b-4d5a-a02e-60b3d96342cd)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Creating volume 689f31e0-e362-456b-9a95-72723b358031 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:16 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:16 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 1073741824 Jun 23 16:02:16 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0cac3256-7bf1-44c6-8883-4d4855bf27f0 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: created successfully Jun 23 16:02:16 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD" returned: 0 in 0.710s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Temporary image 016c4826-d5ee-4472-85c7-0a7c6c905863 is fetched for user 01f17b41148143db81e103f33e8fbc17. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb9e4b-8c42-46b4-8774-1be1f6342322]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:16 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD Jun 23 16:02:16 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:17 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 1073741824" returned: 0 in 0.878s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: deleting Jun 23 16:02:17 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 Jun 23 16:02:17 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: deleting {{(pid=93590) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-797cda71-02d6-4815-84ff-18e0e669998b" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-797cda71-02d6-4815-84ff-18e0e669998b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Deleting offline snapshot 797cda71-02d6-4815-84ff-18e0e669998b of volume 2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] snapshot_file for this snap is: volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a543cf8-59f3-45e1-b0cf-5a99740f02c2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:17 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b Jun 23 16:02:17 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:17 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:17 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031" returned: 0 in 0.767s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1659355696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff6da06-8237-46c7-9c38-d1b81a4cd455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:11Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17204fbc-0d4a-4a24-80d3-af4fd2dd78d8),volume_type_id=17204fbc-0d4a-4a24-80d3-af4fd2dd78d8)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Creating volume 2ff6da06-8237-46c7-9c38-d1b81a4cd455 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:17 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:17 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 1073741824 Jun 23 16:02:17 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c6644c-cebd-4504-9630-f9cc0d7c1a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689f31e0-e362-456b-9a95-72723b358031', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:17 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d62fcae-c2be-4cf2-a0ea-35e726a342b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:17 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Volume volume-689f31e0-e362-456b-9a95-72723b358031 (689f31e0-e362-456b-9a95-72723b358031): created successfully Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d62fcae-c2be-4cf2-a0ea-35e726a342b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (69bd8e75-95ad-486e-9cda-4248e9b5ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a772735e-d1b4-4a56-9a90-ea9746afd943 tempest-TestInstancesWithCinderVolumes-350014114 None] Created volume successfully. Jun 23 16:02:18 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2840c3e7-80c7-428c-89d7-28327d8c314c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1002ffe5-c6f7-4fa5-961e-4f91e9b3ad62]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:18 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c Jun 23 16:02:18 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:18 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 1073741824" returned: 0 in 1.021s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:19 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c" returned: 0 in 0.859s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:19 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 Jun 23 16:02:19 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:19 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b Jun 23 16:02:19 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:19 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455" returned: 0 in 0.701s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.773s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63afcd1e-3cab-4ea3-a912-291a30ba40f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f10110-2cf0-4aad-928e-f0fdbfbd796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffffff3-99ef-4800-bddf-a2df2d0bc30a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:19 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Volume volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 (2ff6da06-8237-46c7-9c38-d1b81a4cd455): created successfully Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f10110-2cf0-4aad-928e-f0fdbfbd796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (e0eba269-c414-4346-bc69-5ba260117e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2d5c8f82-d6eb-41a9-b7c5-df1c3f6f56de tempest-TestInstancesWithCinderVolumes-350014114 None] Created volume successfully. Jun 23 16:02:19 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be Jun 23 16:02:19 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:20 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b" returned: 0 in 0.982s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:20 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b Jun 23 16:02:20 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:20 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" returned: 0 in 0.821s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.723s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-414451533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5eb646-68e2-43d0-9596-09930c4a446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc42e2a5e1d45f8ba2078416dded22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:13Z,use_quota=True,user_id='ee93904777054c8ebd87f2622e9f5369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Creating volume 1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:20 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:20 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a 1073741824 Jun 23 16:02:20 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5f13327-26bc-49ca-9810-26cbd957d757', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:02:20 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-054d7d26-9251-4e94-a942-fb0a40109e0b req-b95147ce-c6aa-4b6a-9ec8-a9086b4f785d tempest-TestServerVolumeAttachmentScenario-1638096414 None] attachment_update completed successfully. Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c.797cda71-02d6-4815-84ff-18e0e669998b" returned: 0 in 0.679s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-797cda71-02d6-4815-84ff-18e0e669998b" released by "_delete_snapshot" :: held 3.494s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" released by "delete_snapshot" :: held 3.521s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-a50d778c-95bf-451f-9cbc-30ba2718ad0a" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-a50d778c-95bf-451f-9cbc-30ba2718ad0a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Deleting offline snapshot a50d778c-95bf-451f-9cbc-30ba2718ad0a of volume 6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] snapshot_file for this snap is: volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7eb894-53d1-4111-bbe2-839f32dd94f4]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:20 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a Jun 23 16:02:20 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:21 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a 1073741824" returned: 0 in 0.946s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:21 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a Jun 23 16:02:21 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:21 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a" returned: 0 in 0.813s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b6c12-1496-4252-810c-657aca87269b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:21 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 Jun 23 16:02:21 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:22 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a" returned: 0 in 0.679s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218185189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19e45f6-1640-4db6-9a88-1a2266bbf6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ba26b104144b82bbc047358e672839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:12Z,use_quota=True,user_id='01f17b41148143db81e103f33e8fbc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244510d6-0fee-4cb5-a008-f0c4b31c67b0),volume_type_id=244510d6-0fee-4cb5-a008-f0c4b31c67b0)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Creating volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:22 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=113,cinder:INSERT=26,cinder:UPDATE=122,cinder:DELETE=6 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cd009e-c3f1-484a-8541-37e35c3f6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5eb646-68e2-43d0-9596-09930c4a446a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:22 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1073741824 Jun 23 16:02:22 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e67f82c-fb6f-4e6f-9802-671a4633d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=119,cinder:INSERT=28,cinder:UPDATE=107,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:02:22 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Volume volume-1b5eb646-68e2-43d0-9596-09930c4a446a (1b5eb646-68e2-43d0-9596-09930c4a446a): created successfully Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e67f82c-fb6f-4e6f-9802-671a4633d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Flow 'volume_create_manager' (807cabd8-f80e-48cb-8856-fdbb86f18cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-55e1a670-7853-4fd6-803f-dcfce1bcd87c tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Created volume successfully. Jun 23 16:02:22 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:22 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a Jun 23 16:02:22 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:23 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1073741824" returned: 0 in 0.853s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:23 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:23 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:23 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a" returned: 0 in 0.729s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:23 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a Jun 23 16:02:23 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:23 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 0.681s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.211s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Creating offline snapshot f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 of volume 1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Attempting download of 016c4826-d5ee-4472-85c7-0a7c6c905863 ((None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}])) to volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e9c8ef-9011-4607-8b27-45eebf6c6f28]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c72a0d-ea85-420b-9ce7-7964c6442a9d]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:23 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28.a50d778c-95bf-451f-9cbc-30ba2718ad0a" returned: 0 in 0.769s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-a50d778c-95bf-451f-9cbc-30ba2718ad0a" released by "_delete_snapshot" :: held 3.220s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" released by "delete_snapshot" :: held 3.244s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:24 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a Jun 23 16:02:24 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:24 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4 Jun 23 16:02:24 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:24 devstack cinder-volume[93590]: WARNING cinder.quota [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2054446584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2054446584, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:24 devstack cinder-volume[93590]: WARNING cinder.quota [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2054446584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2054446584, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['c13c9028-b76a-42f7-af27-d6328a30419d', '8ad29bab-0f17-48d5-adf0-989a625d1a85', '66dd0627-21d6-4d66-bc42-96d2979f3376', '0000fbfe-3fe4-4c44-9815-88443b48c758'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['869cd622-d513-4d52-8c23-0c06c6ae887e', '48c8b0a1-859f-4a41-934c-4228f3982342', '4993581a-b821-45e7-91b4-b242c96783ed', '99ec778f-9f4b-4188-9745-ca5c84750865'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:24 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d7927d24-90a4-4469-b019-ad5503121e1c tempest-GroupSnapshotsTest-2140141254 None] group_snapshot fe6b1568-5f76-470d-8e96-0d1756b617a5: deleted successfully Jun 23 16:02:24 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a" returned: 0 in 0.795s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:24 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 1G Jun 23 16:02:24 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:24 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4" returned: 0 in 0.791s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:24 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4 Jun 23 16:02:24 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8d2ec-90e7-49b8-8201-350bc12c779b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:25 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4" returned: 1 in 0.785s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_016c4826-d5ee-4472-85c7-0a7c6c905863_z_xeish4' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5eb0f7-12fc-48f1-b68b-0fd751a504a2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:25 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c Jun 23 16:02:25 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:25 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD Jun 23 16:02:25 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:25 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 1G" returned: 0 in 0.969s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5eb646-68e2-43d0-9596-09930c4a446a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:25 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5eb646-68e2-43d0-9596-09930c4a446a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 Jun 23 16:02:25 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:26 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c" returned: 0 in 0.905s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:26 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c Jun 23 16:02:26 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:26 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD" returned: 0 in 0.870s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] 016c4826-d5ee-4472-85c7-0a7c6c905863 was qcow2, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:26 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:26 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:26 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5eb646-68e2-43d0-9596-09930c4a446a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" returned: 0 in 0.819s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:26 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 is being set with open permissions: ugo+rw Jun 23 16:02:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:26 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 Jun 23 16:02:26 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:27 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2840c3e7-80c7-428c-89d7-28327d8c314c" returned: 0 in 0.709s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-2840c3e7-80c7-428c-89d7-28327d8c314c" released by "delete_volume" :: held 1.681s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5dc57c-0285-4b78-82e3-b22cd91e1ddc]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:27 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 Jun 23 16:02:27 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:27 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" returned: 0 in 0.799s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:27 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info Jun 23 16:02:27 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-459ec827-e2be-4eca-a006-a161e5463c71 req-4422a914-d338-44bd-a443-c05447368916 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Terminate volume connection completed successfully. Jun 23 16:02:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-459ec827-e2be-4eca-a006-a161e5463c71 req-4422a914-d338-44bd-a443-c05447368916 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Deleting attachment f5f13327-26bc-49ca-9810-26cbd957d757. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:02:28 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28" returned: 0 in 0.970s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:28 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info" returned: 0 in 0.779s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:28 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info is being set with open permissions: ugo+rw Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:28 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28 Jun 23 16:02:28 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:28 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info Jun 23 16:02:28 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:28 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 2.211s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_016c4826-d5ee-4472-85c7-0a7c6c905863_9eodkjp5devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:02:28 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Converted 112.00 MB image at 50.63 MB/s Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:28 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1G Jun 23 16:02:28 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:28 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6bcc1f59-8e91-4117-9581-f7abf81a3a28" returned: 0 in 0.709s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-6bcc1f59-8e91-4117-9581-f7abf81a3a28" released by "delete_volume" :: held 1.759s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['d8442322-f1da-4193-a669-dd0c7bf0c68a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:28 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.info" returned: 0 in 0.808s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.107s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:29 devstack cinder-volume[93590]: WARNING cinder.quota [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2054446584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2054446584, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8a896a75-da1b-4aae-8b66-fc7600cc50fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Create snapshot completed successfully Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['27e994b2-6f2f-4653-8556-4a19fac6b819', '0170663a-249b-428b-a880-4aa2a77270e5', '5a4ca0e1-7615-4df2-9973-50488d79310f', '574370fe-f7b7-451a-b441-b130c4e9cb20'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['d02a9599-a3be-471c-bcad-e372d108b28a', '9defb8bd-2542-4714-900d-5bc75e6e73f5', '143c47be-7afd-4631-bf42-995194b0b215', 'bccf0850-775e-48cc-a261-d4168480d558'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:29 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:29 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:29 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 1G" returned: 0 in 0.812s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df5032-e623-4d18-b5fa-7c01f6ae3b66]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:29 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:29 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:29 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:29 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-233d4063-d1e7-4787-b9d5-2a71b59fe7cc tempest-GroupSnapshotsTest-2140141254 None] Delete group completed successfully. Jun 23 16:02:30 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 0.993s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "cinder-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:30 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:30 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "cinder-quobyte-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Deleting offline snapshot f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 of volume 1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] snapshot_file for this snap is: volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:02:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-76bb2bc5-28ab-4c27-8d01-589d77a74256 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1830209293: creating Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c55d255-3a6f-4d43-a1f9-ab632f46f001]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-76bb2bc5-28ab-4c27-8d01-589d77a74256 tempest-GroupSnapshotsTest-2140141254 None] Group tempest-GroupSnapshotsTest-Group-1830209293: created successfully Jun 23 16:02:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-76bb2bc5-28ab-4c27-8d01-589d77a74256 tempest-GroupSnapshotsTest-2140141254 None] Create group completed successfully. Jun 23 16:02:30 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 Jun 23 16:02:30 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-4ba21fa4-5985-4fd5-9927-cdfcff9d9474 req-2fc0301a-62ec-4495-b124-1f21930c177d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Terminate volume connection completed successfully. Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4ba21fa4-5985-4fd5-9927-cdfcff9d9474 req-2fc0301a-62ec-4495-b124-1f21930c177d tempest-TestServerVolumeAttachmentScenario-1638096414 None] Deleting attachment 495726c5-a1d2-4354-af9a-163aaa843751. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:02:31 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 1 in 0.928s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Downloaded image 016c4826-d5ee-4472-85c7-0a7c6c905863 ((None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}])) to volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Temporary image 016c4826-d5ee-4472-85c7-0a7c6c905863 for user 01f17b41148143db81e103f33e8fbc17 is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Marking volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Copying metadata from image 016c4826-d5ee-4472-85c7-0a7c6c905863 to d19e45f6-1640-4db6-9a88-1a2266bbf6a3. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Creating volume glance metadata for volume d19e45f6-1640-4db6-9a88-1a2266bbf6a3 backed by image 016c4826-d5ee-4472-85c7-0a7c6c905863 with: {'image_id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'image_name': 'tempest-scenario-img--628732716', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441f688d-0493-4a5c-a64e-f6198180bfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3', 'volume_size': 1, 'image_id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/016c4826-d5ee-4472-85c7-0a7c6c905863', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--628732716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72ba26b104144b82bbc047358e672839', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '016c4826-d5ee-4472-85c7-0a7c6c905863', 'created_at': datetime.datetime(2026, 6, 23, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/016c4826-d5ee-4472-85c7-0a7c6c905863/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47e3624-e480-4e61-98e5-3c1e15a722e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:31 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Volume volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 (d19e45f6-1640-4db6-9a88-1a2266bbf6a3): created successfully Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47e3624-e480-4e61-98e5-3c1e15a722e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Flow 'volume_create_manager' (425705fb-b0fc-4c28-9e35-e48cae4d3330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:31 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" returned: 0 in 0.809s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5eb646-68e2-43d0-9596-09930c4a446a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:02:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-054b45d7-5df9-4bd0-b3ed-f35e8246577c tempest-TestInstancesWithCinderVolumes-350014114 None] Created volume successfully. Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4ecd97-2cf5-414e-80e7-c1ff31867ebb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:31 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a Jun 23 16:02:31 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:32 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a" returned: 0 in 0.955s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:32 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 Jun 23 16:02:32 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (588d5b8f-6466-4e3e-93b6-8104fd0db726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fbe583-daa1-41a0-80b9-3f6b20017362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fbe583-daa1-41a0-80b9-3f6b20017362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062269322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ce67d95-97b7-45c2-b917-5e4e917258c0,host='devstack@QuobyteHD#QuobyteHD',id=746511fa-e5a1-4575-be98-3399664e3853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:33Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45212002-1434-4808-b83a-0a077cd8e412),volume_type_id=45212002-1434-4808-b83a-0a077cd8e412)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac3268e-db49-4f5f-b205-5ec4d8c27360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac3268e-db49-4f5f-b205-5ec4d8c27360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7bbd98-e103-47a3-b7f5-dd21bb80b008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7bbd98-e103-47a3-b7f5-dd21bb80b008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746511fa-e5a1-4575-be98-3399664e3853', 'volume_name': 'volume-746511fa-e5a1-4575-be98-3399664e3853', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366ff617-a0a0-4fa4-a7f5-51a6294f6386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366ff617-a0a0-4fa4-a7f5-51a6294f6386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b482961e-297c-404b-8744-f2bceca7a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:32 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Volume 746511fa-e5a1-4575-be98-3399664e3853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746511fa-e5a1-4575-be98-3399664e3853', 'volume_size': 1} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ce67d95-97b7-45c2-b917-5e4e917258c0,created_at=2026-06-23T14:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062269322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ce67d95-97b7-45c2-b917-5e4e917258c0,host='devstack@QuobyteHD#QuobyteHD',id=746511fa-e5a1-4575-be98-3399664e3853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bacb679c8a462fa2d4a6cd25bb9d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:33Z,use_quota=True,user_id='e3ffa97d4a694a35930c7dbc2c4bdf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45212002-1434-4808-b83a-0a077cd8e412),volume_type_id=45212002-1434-4808-b83a-0a077cd8e412)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Creating volume 746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:32 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:32 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 1073741824 Jun 23 16:02:32 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:33 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" returned: 0 in 1.001s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:33 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26 Jun 23 16:02:33 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:33 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 1073741824" returned: 0 in 1.109s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:33 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 Jun 23 16:02:33 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:34 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a.f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" returned: 0 in 0.822s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26" released by "_delete_snapshot" :: held 3.713s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" released by "delete_snapshot" :: held 3.751s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Created reservations ['6e618df3-6b68-4612-822d-c34fa02b85ee', 'd80c82df-bb0e-477d-bdbf-a27d1b8a3006', 'ce9da245-832d-43bd-b0c7-7f8ddfc69724', 'f4c71341-23b3-4e18-a45e-b177ddff72d8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Delete snapshot completed successfully. Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86e35252-2542-4515-bd32-003fe3349fb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-f1ae5913-d2d9-4de7-bcdb-e3ef503f5d26-delete_snapshot" released by "delete_snapshot" :: held 3.912s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:34 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853" returned: 0 in 0.746s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b482961e-297c-404b-8744-f2bceca7a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746511fa-e5a1-4575-be98-3399664e3853', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd50d03-0f58-4e51-afd9-94ba6e4a676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:34 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Volume volume-746511fa-e5a1-4575-be98-3399664e3853 (746511fa-e5a1-4575-be98-3399664e3853): created successfully Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd50d03-0f58-4e51-afd9-94ba6e4a676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Flow 'volume_create_manager' (588d5b8f-6466-4e3e-93b6-8104fd0db726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5e062f63-05e2-45d9-8a70-c049edff70a3 tempest-GroupSnapshotsTest-2140141254 None] Created volume successfully. Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "cinder-1b5eb646-68e2-43d0-9596-09930c4a446a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-1b5eb646-68e2-43d0-9596-09930c4a446a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c1416-52cb-4a5c-8286-973c5e0f35f0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:35 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a Jun 23 16:02:35 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] GroupSnapshot d7573331-3cc9-4c96-ace2-45004398e1c2: creating. Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Group snapshot d7573331-3cc9-4c96-ace2-45004398e1c2: creating. {{(pid=93590) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Creating offline snapshot c7d2e42c-da0f-43cc-a3b1-9f14cd16108a of volume 746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[200dc7f0-bd5e-44ea-9987-1daca1511dd8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:35 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 Jun 23 16:02:35 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:36 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a" returned: 0 in 0.934s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:36 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a Jun 23 16:02:36 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:36 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853" returned: 0 in 0.817s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:36 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a 1G Jun 23 16:02:36 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:36 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1b5eb646-68e2-43d0-9596-09930c4a446a" returned: 0 in 0.778s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-quobyte-1b5eb646-68e2-43d0-9596-09930c4a446a" released by "delete_volume" :: held 1.817s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Created reservations ['6101954b-5068-47e1-a74c-ccb9e2bfc019', 'cee30a34-787c-44ed-94a6-20312677a0e2', '28d47057-b6a9-40ba-ad9e-5236fa057316', 'c008af56-d2c8-471e-a62c-cce652e90ebe'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:37 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:37 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:37 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a 1G" returned: 0 in 1.129s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746511fa-e5a1-4575-be98-3399664e3853 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:37 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746511fa-e5a1-4575-be98-3399664e3853 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a Jun 23 16:02:37 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:38 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.880s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:38 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Deleted volume successfully. Jun 23 16:02:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a8b7cc12-7d26-4fe2-ad3a-2fbe539c2ada tempest-VolumeSnapshotQuotasNegativeTestJSON-1615825924 None] Lock "cinder-1b5eb646-68e2-43d0-9596-09930c4a446a-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:38 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746511fa-e5a1-4575-be98-3399664e3853 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" returned: 0 in 0.879s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:38 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:38 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a Jun 23 16:02:38 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:39 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" returned: 0 in 0.897s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:39 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info Jun 23 16:02:39 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:40 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info" returned: 0 in 0.802s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:40 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:02:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:40 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info Jun 23 16:02:40 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:41 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.info" returned: 0 in 0.821s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.460s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.418s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb7fb6-36fd-4036-b0a9-66b614a76e3a]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:41 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3a6ddbfd-800d-43cd-bcca-c65019867d33 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot d7573331-3cc9-4c96-ace2-45004398e1c2: created successfully Jun 23 16:02:41 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:41 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "cinder-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "cinder-quobyte-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:42 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 0.887s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-quobyte-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" acquired by "delete_volume" :: waited 0.043s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953f785-d275-404d-b046-c799293105f0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:42 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:02:42 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot d7573331-3cc9-4c96-ace2-45004398e1c2: deleting Jun 23 16:02:42 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be Jun 23 16:02:42 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot d7573331-3cc9-4c96-ace2-45004398e1c2: deleting {{(pid=93590) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Deleting offline snapshot c7d2e42c-da0f-43cc-a3b1-9f14cd16108a of volume 746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] snapshot_file for this snap is: volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e1502-7060-42b5-b105-42033e44d0d5]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:42 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a Jun 23 16:02:42 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:43 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" returned: 0 in 1.168s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:43 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 1 in 1.241s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.211s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:43 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be Jun 23 16:02:43 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '261a4c69-460e-4963-94a1-5677803f9c08', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:02:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-0f6e8208-3d4c-41b1-bc85-f2d03660fa24 req-6256f907-de28-4772-a8ce-d02ef43e8688 tempest-TestInstancesWithCinderVolumes-350014114 None] attachment_update completed successfully. Jun 23 16:02:43 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" returned: 0 in 1.077s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746511fa-e5a1-4575-be98-3399664e3853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[903bab9b-a340-4908-a788-1f45affe6815]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:43 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 Jun 23 16:02:43 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:44 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" returned: 0 in 0.837s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-quobyte-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be" released by "delete_volume" :: held 2.072s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Created reservations ['daf99b8f-4bac-4baa-a120-28a4899c5dbb', '8975dd57-eb53-4526-bf2c-3f7a1887aad3', '920ef250-96e7-4be3-9bf9-6768c74dffa7', 'a243dce3-21ea-48cf-85b4-31ec6af791a7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:44 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:44 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:44 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853" returned: 0 in 0.979s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:44 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "cinder-9880c3be-3c53-4b3e-8abc-6cf228e3789a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:44 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-9880c3be-3c53-4b3e-8abc-6cf228e3789a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "cinder-quobyte-9880c3be-3c53-4b3e-8abc-6cf228e3789a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-quobyte-9880c3be-3c53-4b3e-8abc-6cf228e3789a" acquired by "delete_volume" :: waited 0.035s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41e1d4-1dcc-48c2-87bb-a268fad9eabf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:45 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a Jun 23 16:02:45 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:45 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.792s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Deleted volume successfully. Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f755a0e6-2280-4440-84ff-67bd865ef046 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-bcd6c0b6-dc3a-4517-ab7d-624fa5a9c8be-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:45 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" returned: 0 in 1.007s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:45 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a Jun 23 16:02:45 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:46 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a" returned: 0 in 1.169s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:46 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a Jun 23 16:02:46 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:46 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853.c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" returned: 0 in 0.972s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-c7d2e42c-da0f-43cc-a3b1-9f14cd16108a" released by "_delete_snapshot" :: held 4.192s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" released by "delete_snapshot" :: held 4.237s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:46 devstack cinder-volume[93590]: WARNING cinder.quota [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-516262052 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-516262052, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:46 devstack cinder-volume[93590]: WARNING cinder.quota [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-516262052 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-516262052, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['e59fc4c7-d5a6-495a-a3b3-aa983322a6df', 'f75bd5e1-e236-4b45-9027-f827915d24a3', 'b5707cbd-10a1-481f-8789-44cf48a7f279', 'a7f59100-b147-4d80-bc56-3852465c1bec'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:46 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-48eb2ffc-fd57-4430-829a-524f20189494 tempest-GroupSnapshotsTest-2140141254 None] group_snapshot d7573331-3cc9-4c96-ace2-45004398e1c2: deleted successfully Jun 23 16:02:46 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9880c3be-3c53-4b3e-8abc-6cf228e3789a" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-quobyte-9880c3be-3c53-4b3e-8abc-6cf228e3789a" released by "delete_volume" :: held 2.032s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Created reservations ['f5854f1a-56c4-48bd-a2ec-cfeb45266613', 'c05bc249-2c2a-41a9-afd7-fd46fe33f2f9', '940280d1-6964-4563-b00d-eadc3e04541f', 'f4e1234c-bdbb-4790-a702-fa96ab334b2e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:47 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:47 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d0fef-e40c-45f3-bb12-b2185f48a843]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:47 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 Jun 23 16:02:47 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:48 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.839s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:48 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Deleted volume successfully. Jun 23 16:02:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e4ca2e1b-104b-4e8d-8042-9e67de7197c9 tempest-TestServerVolumeAttachmentScenario-1638096414 None] Lock "cinder-9880c3be-3c53-4b3e-8abc-6cf228e3789a-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:48 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853" returned: 0 in 0.981s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:48 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853 Jun 23 16:02:48 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:49 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-746511fa-e5a1-4575-be98-3399664e3853" returned: 0 in 0.958s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Lock "cinder-quobyte-746511fa-e5a1-4575-be98-3399664e3853" released by "delete_volume" :: held 2.077s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:49 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['96cc58ef-30de-4276-afc1-726497773662'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:49 devstack cinder-volume[93590]: WARNING cinder.quota [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-516262052 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-516262052, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:02:49 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Created reservations ['33cd9a39-d377-49d1-917d-d1ff5f0c73a5', '940c90d2-9d6d-4b11-9a28-c125f83ff0dc', '3f1dcde9-533c-4329-8989-72f00bf63aa2', 'db9457c8-8354-4ca4-8711-0caa13274f02'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:50 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:50 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:51 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.587s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:51 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:02:51 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-83548045-ff15-42b1-8ef3-1aba87a18e82 tempest-GroupSnapshotsTest-2140141254 None] Delete group completed successfully. Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Flow 'volume_create_manager' (ecb4ac62-db37-4699-a981-c86e128acf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f408117d-f4bc-4310-b377-d3b75b963b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f408117d-f4bc-4310-b377-d3b75b963b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-140705637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac94db2-5948-4909-b21d-301918358595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc4b7d5ee12468fbde90538e45aa4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:53Z,use_quota=True,user_id='3f2d663165ae4e01be7e5f0cf9da198b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9820320a-f27a-43b4-8a36-e8d2553a9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9820320a-f27a-43b4-8a36-e8d2553a9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d835478d-8051-4466-9260-0637231f04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d835478d-8051-4466-9260-0637231f04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac94db2-5948-4909-b21d-301918358595', 'volume_name': 'volume-4ac94db2-5948-4909-b21d-301918358595', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37e86a1-573b-4b6b-82a4-ebf0e4280356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37e86a1-573b-4b6b-82a4-ebf0e4280356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc178ba-95a2-4dea-91a9-5b36c6790d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Volume 4ac94db2-5948-4909-b21d-301918358595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac94db2-5948-4909-b21d-301918358595', 'volume_size': 1} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-140705637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac94db2-5948-4909-b21d-301918358595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc4b7d5ee12468fbde90538e45aa4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:02:53Z,use_quota=True,user_id='3f2d663165ae4e01be7e5f0cf9da198b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Creating volume 4ac94db2-5948-4909-b21d-301918358595 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:02:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:02:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:53 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 1073741824 Jun 23 16:02:53 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:55 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 1073741824" returned: 0 in 1.423s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:55 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 Jun 23 16:02:55 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:56 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595" returned: 0 in 1.128s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.655s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc178ba-95a2-4dea-91a9-5b36c6790d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac94db2-5948-4909-b21d-301918358595', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6aecbb0-0f7b-45cf-8bbc-da02dd96384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:02:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Volume volume-4ac94db2-5948-4909-b21d-301918358595 (4ac94db2-5948-4909-b21d-301918358595): created successfully Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6aecbb0-0f7b-45cf-8bbc-da02dd96384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:02:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Flow 'volume_create_manager' (ecb4ac62-db37-4699-a981-c86e128acf53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:02:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5c26d1c0-4793-4775-92b2-348c340aa0a9 tempest-AbsoluteLimitsTests-729938921 None] Created volume successfully. Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Acquiring lock "cinder-4ac94db2-5948-4909-b21d-301918358595-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "cinder-4ac94db2-5948-4909-b21d-301918358595-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Acquiring lock "cinder-quobyte-4ac94db2-5948-4909-b21d-301918358595" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "cinder-quobyte-4ac94db2-5948-4909-b21d-301918358595" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[34227026-17fa-4f4f-96fb-fcb6b3aa5c59]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:02:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:57 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 Jun 23 16:02:57 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:58 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595" returned: 0 in 1.222s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:58 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595 Jun 23 16:02:58 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4ac94db2-5948-4909-b21d-301918358595" returned: 0 in 0.898s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:02:59 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "cinder-quobyte-4ac94db2-5948-4909-b21d-301918358595" released by "delete_volume" :: held 2.221s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Created reservations ['b81d7a45-9f4b-4737-9899-2c38f4f11597', '81685256-03fb-4098-8c5f-f835f7b925ce', '3c600bfb-de08-41d1-9515-348dd4d56ebb', 'f15db5b1-4b8e-4af9-a361-7671a3bff65f'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:02:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:02:59 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:02:59 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-735ca9f8-5f84-4bfe-a304-e53d8ed37770 tempest-GroupSnapshotsV319Test-461991096 None] Group tempest-GroupSnapshotsV319Test-Group-1112489977: creating Jun 23 16:03:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-735ca9f8-5f84-4bfe-a304-e53d8ed37770 tempest-GroupSnapshotsV319Test-461991096 None] Group tempest-GroupSnapshotsV319Test-Group-1112489977: created successfully Jun 23 16:03:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-735ca9f8-5f84-4bfe-a304-e53d8ed37770 tempest-GroupSnapshotsV319Test-461991096 None] Create group completed successfully. Jun 23 16:03:01 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.292s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:01 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Deleted volume successfully. Jun 23 16:03:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3737372-c959-4ffc-bddc-971a1ddf992a tempest-AbsoluteLimitsTests-729938921 None] Lock "cinder-4ac94db2-5948-4909-b21d-301918358595-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Flow 'volume_create_manager' (b0c91781-6af4-419d-8fb2-5ceab43a1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d2370b-57c3-4148-870b-7c2feb2246ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d2370b-57c3-4148-870b-7c2feb2246ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990802899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dec123f-d173-4bd7-9afa-d222d061ea93,host='devstack@QuobyteHD#QuobyteHD',id=c24ac4d0-fb88-40ec-816a-fbe8f128e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2925f122027c42829d278cb1201212b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:02Z,use_quota=True,user_id='c65d085568024b988581aa9d1deeb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb44069-2e66-4ea2-9f5a-5249015dbb43),volume_type_id=afb44069-2e66-4ea2-9f5a-5249015dbb43)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b84d005-2fe6-4ab5-9162-cd442389cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b84d005-2fe6-4ab5-9162-cd442389cb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3818458-43f3-4a0b-ac45-8d870943e7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3818458-43f3-4a0b-ac45-8d870943e7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24ac4d0-fb88-40ec-816a-fbe8f128e56a', 'volume_name': 'volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9afad6a-f51c-4706-aa22-66792c25ac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9afad6a-f51c-4706-aa22-66792c25ac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7f2af2-1d35-42d8-85d5-d35385bc44b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Volume c24ac4d0-fb88-40ec-816a-fbe8f128e56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a', 'volume_size': 1} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0dec123f-d173-4bd7-9afa-d222d061ea93,created_at=2026-06-23T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990802899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dec123f-d173-4bd7-9afa-d222d061ea93,host='devstack@QuobyteHD#QuobyteHD',id=c24ac4d0-fb88-40ec-816a-fbe8f128e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2925f122027c42829d278cb1201212b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:02Z,use_quota=True,user_id='c65d085568024b988581aa9d1deeb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb44069-2e66-4ea2-9f5a-5249015dbb43),volume_type_id=afb44069-2e66-4ea2-9f5a-5249015dbb43)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Creating volume c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:02 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:02 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a 1073741824 Jun 23 16:03:02 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:03 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a 1073741824" returned: 0 in 1.233s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:04 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a Jun 23 16:03:04 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:05 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" returned: 0 in 1.359s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] <== create_volume: return (2656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.665s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7f2af2-1d35-42d8-85d5-d35385bc44b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e6dc5-cba6-4c8c-be94-f028d167eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:05 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Volume volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a (c24ac4d0-fb88-40ec-816a-fbe8f128e56a): created successfully Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e6dc5-cba6-4c8c-be94-f028d167eb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Flow 'volume_create_manager' (b0c91781-6af4-419d-8fb2-5ceab43a1039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7d4c7b8f-67e1-4f3e-b48c-a4b583d3622b tempest-GroupSnapshotsV319Test-461991096 None] Created volume successfully. Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:05 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:05 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:07 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.156s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:03:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] GroupSnapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: creating. Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Group snapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: creating. {{(pid=93590) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Creating offline snapshot 47cbd8c9-180f-4422-9092-0c25c8387cf8 of volume c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b27fbb-4fe9-4c0c-bebd-e50f11d40614]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:07 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a Jun 23 16:03:07 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:08 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" returned: 0 in 1.327s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:08 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 1G Jun 23 16:03:08 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:09 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 1G" returned: 0 in 1.024s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:09 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 Jun 23 16:03:09 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Flow 'volume_create_manager' (270aa1bd-44f8-4b6f-9e49-bf58a3a2adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ceec115-158d-4ed4-805e-fe1dfe1efd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ceec115-158d-4ed4-805e-fe1dfe1efd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1504561832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e592c5-d354-447e-8f4e-3edb67d81ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b3f14f58de4b6f931100cb2d6f037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:10Z,use_quota=True,user_id='e8adf310ee9c48369fc5c46a8cffcba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419300fd-918c-4140-bae4-1c9211b30d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419300fd-918c-4140-bae4-1c9211b30d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbf597e-d87f-455e-900a-1dc2c8ba7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbf597e-d87f-455e-900a-1dc2c8ba7554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e592c5-d354-447e-8f4e-3edb67d81ef9', 'volume_name': 'volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5921b8-0698-474e-b381-81653b29234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5921b8-0698-474e-b381-81653b29234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a857796-e1a0-49e2-b4d3-d091599d5b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Volume a2e592c5-d354-447e-8f4e-3edb67d81ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9', 'volume_size': 1} Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:10 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8" returned: 0 in 0.897s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:10 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:03:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:10 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 Jun 23 16:03:10 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:11 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8" returned: 0 in 0.664s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:11 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info Jun 23 16:03:11 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:12 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info" returned: 0 in 0.648s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:12 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:12 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info Jun 23 16:03:12 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:12 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.info" returned: 0 in 0.682s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.398s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1504561832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e592c5-d354-447e-8f4e-3edb67d81ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b3f14f58de4b6f931100cb2d6f037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:10Z,use_quota=True,user_id='e8adf310ee9c48369fc5c46a8cffcba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Creating volume a2e592c5-d354-447e-8f4e-3edb67d81ef9 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:12 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:12 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 1073741824 Jun 23 16:03:12 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c9a3d36d-82fb-4bc4-90e0-e668059773bf tempest-GroupSnapshotsV319Test-461991096 None] group_snapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: created successfully Jun 23 16:03:13 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 1073741824" returned: 0 in 0.884s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:13 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 Jun 23 16:03:13 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] group_snapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: deleting Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] group_snapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: deleting {{(pid=93590) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "cinder-quobyte-47cbd8c9-180f-4422-9092-0c25c8387cf8" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-47cbd8c9-180f-4422-9092-0c25c8387cf8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Deleting offline snapshot 47cbd8c9-180f-4422-9092-0c25c8387cf8 of volume c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] snapshot_file for this snap is: volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85adcc3-047e-486a-a220-f157f3462065]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:14 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 Jun 23 16:03:14 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:14 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9" returned: 0 in 0.745s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a857796-e1a0-49e2-b4d3-d091599d5b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fbd0e4-2077-4535-9a28-0e8dded10bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:14 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Volume volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 (a2e592c5-d354-447e-8f4e-3edb67d81ef9): created successfully Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fbd0e4-2077-4535-9a28-0e8dded10bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Flow 'volume_create_manager' (270aa1bd-44f8-4b6f-9e49-bf58a3a2adcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b58b1c07-941a-4c06-b044-2c8be7e402f1 tempest-VolumesMetadataTest-972795402 None] Created volume successfully. Jun 23 16:03:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8" returned: 0 in 0.997s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:03:15 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e529cf7-c060-475c-99c1-725b8c82fd19]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:15 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a Jun 23 16:03:15 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:16 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" returned: 0 in 1.131s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:16 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 Jun 23 16:03:16 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Acquiring lock "cinder-a2e592c5-d354-447e-8f4e-3edb67d81ef9-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "cinder-a2e592c5-d354-447e-8f4e-3edb67d81ef9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Acquiring lock "cinder-quobyte-a2e592c5-d354-447e-8f4e-3edb67d81ef9" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "cinder-quobyte-a2e592c5-d354-447e-8f4e-3edb67d81ef9" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda981b-fbc4-4812-b840-6df9840e5b1e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:17 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 Jun 23 16:03:17 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:17 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8" returned: 0 in 1.290s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:17 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8 Jun 23 16:03:17 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:18 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9" returned: 0 in 1.301s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:18 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9 Jun 23 16:03:18 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:18 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a.47cbd8c9-180f-4422-9092-0c25c8387cf8" returned: 0 in 0.774s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-47cbd8c9-180f-4422-9092-0c25c8387cf8" released by "_delete_snapshot" :: held 4.352s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" released by "delete_snapshot" :: held 4.379s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:18 devstack cinder-volume[93590]: WARNING cinder.quota [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-949708661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-949708661, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:18 devstack cinder-volume[93590]: WARNING cinder.quota [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-949708661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-949708661, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:18 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] Created reservations ['5743aa9c-6968-41de-9a38-5f0642320e68', 'bc4b07f8-eb05-4b84-8730-5cf2aadf54b7', 'ad1f5180-aedd-4f0a-a48e-c047c0afa659', 'cf4bb690-830d-4d41-a99d-e39f1467cf29'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8e14a066-f0e2-4d13-81c4-eeb08c1e7f0d tempest-GroupSnapshotsV319Test-461991096 None] group_snapshot 51f4527e-a9c2-4e8f-9426-c7812083e512: deleted successfully Jun 23 16:03:19 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a2e592c5-d354-447e-8f4e-3edb67d81ef9" returned: 0 in 0.702s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "cinder-quobyte-a2e592c5-d354-447e-8f4e-3edb67d81ef9" released by "delete_volume" :: held 2.061s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Created reservations ['45546c9c-7b1c-4fbf-a1e1-30239367de14', '889aa5c7-3142-4526-a8b7-0a7fc8408ea7', 'c1905a2f-04fd-4a30-8a82-7affdadb207c', '76065014-c875-40e2-aaaa-1574c777db88'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:19 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:19 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:19 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.669s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Deleted volume successfully. Jun 23 16:03:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d78e1df1-505d-45a6-b2db-3b73d92ce636 tempest-VolumesMetadataTest-972795402 None] Lock "cinder-a2e592c5-d354-447e-8f4e-3edb67d81ef9-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3edec5-9802-4191-a158-7e76d0c58fda]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:20 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a Jun 23 16:03:20 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:21 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" returned: 0 in 1.054s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:21 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a Jun 23 16:03:21 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4723a2e0-9656-4577-a1a7-2cb88d3cf827]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:21 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 Jun 23 16:03:21 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:22 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" returned: 0 in 0.818s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Lock "cinder-quobyte-c24ac4d0-fb88-40ec-816a-fbe8f128e56a" released by "delete_volume" :: held 1.969s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Created reservations ['2b7693c7-2d8f-45ad-952f-098872e4e16a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:22 devstack cinder-volume[93590]: WARNING cinder.quota [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-949708661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-949708661, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=117,cinder:DELETE=7,cinder:SELECT=127,cinder:INSERT=41 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Created reservations ['28f4a8d9-ca42-4a7e-8d04-955441b67c80', '1198377e-9da5-4cab-a14e-2cc34a46dadd', 'f23f1aac-cc3b-40ff-896e-04dd23b19be0', '4bf1b85e-d14d-4617-9644-0cc9abdb5da9'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=137,cinder:SELECT=114,cinder:INSERT=34,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:03:22 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031" returned: 0 in 1.080s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.114s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:22 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-689f31e0-e362-456b-9a95-72723b358031', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39b18d7a-6aae-47da-bfa2-4130c5a22974', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:03:22 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:22 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-fa0bb9ad-497e-4189-a1af-bb6b37c7e49e req-e067ab92-7509-454f-8675-5516afd8a560 tempest-TestInstancesWithCinderVolumes-350014114 None] attachment_update completed successfully. Jun 23 16:03:23 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.790s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:23 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b86cb346-3347-4ad5-9fed-e69faab7a07b tempest-GroupSnapshotsV319Test-461991096 None] Delete group completed successfully. Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Flow 'volume_create_manager' (3dbb2bae-87b0-4a16-90f5-8f8d4baead5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c943610d-e79b-4a00-9ea8-c4eaa14c752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c943610d-e79b-4a00-9ea8-c4eaa14c752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-907369233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3d5369-8a1e-4da9-80c5-129a01950e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28f90b9c5b5448983b8380e2fc8942c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:26Z,use_quota=True,user_id='09948e0c04cf4968877f948cf5b59312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097d3f04-47d4-4371-9913-492d806626a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097d3f04-47d4-4371-9913-492d806626a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb84bec-c21f-416d-a7fd-0c24e984298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb84bec-c21f-416d-a7fd-0c24e984298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3d5369-8a1e-4da9-80c5-129a01950e53', 'volume_name': 'volume-ac3d5369-8a1e-4da9-80c5-129a01950e53', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86206a33-54d7-4137-a87a-e88f3eb6902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86206a33-54d7-4137-a87a-e88f3eb6902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54a9a12-9cbe-4192-8e63-b4ce89da2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:25 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Volume ac3d5369-8a1e-4da9-80c5-129a01950e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3d5369-8a1e-4da9-80c5-129a01950e53', 'volume_size': 1} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-907369233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3d5369-8a1e-4da9-80c5-129a01950e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28f90b9c5b5448983b8380e2fc8942c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:26Z,use_quota=True,user_id='09948e0c04cf4968877f948cf5b59312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Creating volume ac3d5369-8a1e-4da9-80c5-129a01950e53 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:25 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:25 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 1073741824 Jun 23 16:03:25 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:27 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 1073741824" returned: 0 in 1.169s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:27 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 Jun 23 16:03:27 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:28 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53" returned: 0 in 0.962s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54a9a12-9cbe-4192-8e63-b4ce89da2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3d5369-8a1e-4da9-80c5-129a01950e53', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f0f4-3c89-4894-8a38-5336ddd22e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:28 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Volume volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 (ac3d5369-8a1e-4da9-80c5-129a01950e53): created successfully Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f0f4-3c89-4894-8a38-5336ddd22e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Flow 'volume_create_manager' (3dbb2bae-87b0-4a16-90f5-8f8d4baead5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d2e52816-76e0-41b3-afdf-862b3e0c55ec tempest-VolumesTransfersV355Test-1044264434 None] Created volume successfully. Jun 23 16:03:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-44d3084f-d587-41f7-9ff1-301f24ae0c36 tempest-VolumesTransfersV355Test-1743093069 None] Transfer volume completed successfully. Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "cinder-ac3d5369-8a1e-4da9-80c5-129a01950e53-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-ac3d5369-8a1e-4da9-80c5-129a01950e53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "cinder-quobyte-ac3d5369-8a1e-4da9-80c5-129a01950e53" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-quobyte-ac3d5369-8a1e-4da9-80c5-129a01950e53" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528b232-06b1-491b-98fc-8ad17970aa6e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:31 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 Jun 23 16:03:31 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47563e47-a1ee-49e9-8022-c97260d46b5a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:31 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 Jun 23 16:03:31 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:32 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53" returned: 0 in 1.155s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:32 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53 Jun 23 16:03:32 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:32 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455" returned: 0 in 0.969s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79d40749-2e25-4b3c-9586-babfd77d58e8', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:03:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-fbee5b96-67d0-407e-9ca4-839026c74728 req-b921a365-0766-464d-9a0e-fdce58b0b3a5 tempest-TestInstancesWithCinderVolumes-350014114 None] attachment_update completed successfully. Jun 23 16:03:33 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ac3d5369-8a1e-4da9-80c5-129a01950e53" returned: 0 in 0.794s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-quobyte-ac3d5369-8a1e-4da9-80c5-129a01950e53" released by "delete_volume" :: held 2.044s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Created reservations ['217896b7-2968-4e4e-8506-687b4ef3f0a9', '5dc82b9c-2c8a-41ca-80e7-c5943d0357dc', '5a964624-ca4d-4e8e-93dd-c8c49f327654', 'e43c60bf-5159-4ab6-8305-b519e40110be'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:33 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:33 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:34 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.128s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Deleted volume successfully. Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6249c7d5-ccb7-4189-bb0d-d5aa9c4c85aa tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-ac3d5369-8a1e-4da9-80c5-129a01950e53-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Flow 'volume_create_manager' (7b0cb558-4288-44e5-8778-82a34bcf92dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f068d9be-2ea7-4c20-804a-83097683ebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f068d9be-2ea7-4c20-804a-83097683ebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-268574501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d406a7a-ad32-4e87-9cea-a8c5ef0b99de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28f90b9c5b5448983b8380e2fc8942c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:35Z,use_quota=True,user_id='09948e0c04cf4968877f948cf5b59312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0887fb87-3059-4008-b48a-0aadc5b44451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0887fb87-3059-4008-b48a-0aadc5b44451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b36e14-72de-481a-9e11-1c018d55f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b36e14-72de-481a-9e11-1c018d55f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d406a7a-ad32-4e87-9cea-a8c5ef0b99de', 'volume_name': 'volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09d1ca2-3ae5-41ea-8d8e-2270804b585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09d1ca2-3ae5-41ea-8d8e-2270804b585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85162cd1-c636-4442-a04f-50a66f5b7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:34 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Volume 8d406a7a-ad32-4e87-9cea-a8c5ef0b99de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de', 'volume_size': 1} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-268574501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d406a7a-ad32-4e87-9cea-a8c5ef0b99de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28f90b9c5b5448983b8380e2fc8942c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:35Z,use_quota=True,user_id='09948e0c04cf4968877f948cf5b59312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Creating volume 8d406a7a-ad32-4e87-9cea-a8c5ef0b99de {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:34 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:34 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de 1073741824 Jun 23 16:03:34 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:35 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de 1073741824" returned: 0 in 1.087s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:36 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de Jun 23 16:03:36 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:36 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" returned: 0 in 0.850s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85162cd1-c636-4442-a04f-50a66f5b7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8869cd-66ab-485e-a6f1-5ed83cf7aa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:36 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Volume volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de (8d406a7a-ad32-4e87-9cea-a8c5ef0b99de): created successfully Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8869cd-66ab-485e-a6f1-5ed83cf7aa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Flow 'volume_create_manager' (7b0cb558-4288-44e5-8778-82a34bcf92dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e24add6e-94b5-45d2-b7e1-97666992e4aa tempest-VolumesTransfersV355Test-1044264434 None] Created volume successfully. Jun 23 16:03:37 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e25dc0e6-ca69-4872-a064-ef71423b39d1 tempest-GroupsTest-343741614 None] Group tempest-Group1-1595930122: creating Jun 23 16:03:37 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e25dc0e6-ca69-4872-a064-ef71423b39d1 tempest-GroupsTest-343741614 None] Group tempest-Group1-1595930122: created successfully Jun 23 16:03:37 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e25dc0e6-ca69-4872-a064-ef71423b39d1 tempest-GroupsTest-343741614 None] Create group completed successfully. Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "cinder-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "cinder-quobyte-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-quobyte-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b988e14-290e-4dd9-80ee-463383132608]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:38 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de Jun 23 16:03:38 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-65184aa3-4154-4001-a5fa-63e511b1d544 tempest-GroupsTest-343741614 None] Group tempest-Group2-274347346: creating Jun 23 16:03:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-65184aa3-4154-4001-a5fa-63e511b1d544 tempest-GroupsTest-343741614 None] Group tempest-Group2-274347346: created successfully Jun 23 16:03:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-65184aa3-4154-4001-a5fa-63e511b1d544 tempest-GroupsTest-343741614 None] Create group completed successfully. Jun 23 16:03:39 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" returned: 0 in 0.957s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:39 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de Jun 23 16:03:39 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Flow 'volume_create_manager' (a1f9f98a-ee6c-4e6e-89f7-c848fd11ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5959303-9f99-4ccb-ab9f-4fbc6549e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5959303-9f99-4ccb-ab9f-4fbc6549e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-286860413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f58c5b4-ec9c-4e45-946a-1783bb710f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838d13e7c55f400ab4a15f7768509ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:40Z,use_quota=True,user_id='b4ea1a71c79e4c1ea2b7abe095d41347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4393f0-db37-4e07-ace1-8bdaf0846f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4393f0-db37-4e07-ace1-8bdaf0846f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc783362-64e0-44a9-bf8a-75c9c7e3ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:03:39 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" returned: 0 in 0.734s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-quobyte-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de" released by "delete_volume" :: held 1.747s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Created reservations ['2710bea1-2484-4b94-a97a-7a171e382a1b', 'a518e794-f946-4c50-b7e6-133479155b6d', 'f089ed74-5427-48dd-8565-94290c01e5b7', '36cc3fb4-039f-4148-8011-1b5b7b21642d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc783362-64e0-44a9-bf8a-75c9c7e3ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'volume_name': 'volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eafed4b-66ba-45b7-82ce-bc6cccae8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eafed4b-66ba-45b7-82ce-bc6cccae8891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be7aa40-2562-4f2b-b90b-f7b3f1384972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Trying to clone 6f58c5b4-ec9c-4e45-946a-1783bb710f99 from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:40 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:40 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:03:40 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Image download 20.69 MB at 20.69 MB/s Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccb325-64b4-4a8d-b531-7a0eccbf8d8c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:40 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD Jun 23 16:03:40 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (1fa85fe2-b99c-48a1-b847-bee3f79e6c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d387275-8358-4f50-81f0-642de3079f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d387275-8358-4f50-81f0-642de3079f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1114084979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d4abd1-f9de-467c-8430-d34957a0dd32,host='devstack@QuobyteHD#QuobyteHD',id=306a60ee-42e5-429a-ba5d-0b7a6f6c050a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:41Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d19a502-4f3a-4794-8a4a-c408a22713ea),volume_type_id=5d19a502-4f3a-4794-8a4a-c408a22713ea)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eb0472-fa9e-486b-96b8-c97be0dd084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eb0472-fa9e-486b-96b8-c97be0dd084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55a6ff-bc55-4881-b048-c3e333b7a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55a6ff-bc55-4881-b048-c3e333b7a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306a60ee-42e5-429a-ba5d-0b7a6f6c050a', 'volume_name': 'volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded52426-e1e6-414a-8cfb-a1837cb865aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded52426-e1e6-414a-8cfb-a1837cb865aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf826e-4b38-4455-a167-155349643bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Volume 306a60ee-42e5-429a-ba5d-0b7a6f6c050a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a', 'volume_size': 1} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22d4abd1-f9de-467c-8430-d34957a0dd32,created_at=2026-06-23T14:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1114084979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d4abd1-f9de-467c-8430-d34957a0dd32,host='devstack@QuobyteHD#QuobyteHD',id=306a60ee-42e5-429a-ba5d-0b7a6f6c050a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:41Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d19a502-4f3a-4794-8a4a-c408a22713ea),volume_type_id=5d19a502-4f3a-4794-8a4a-c408a22713ea)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Creating volume 306a60ee-42e5-429a-ba5d-0b7a6f6c050a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:41 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a 1073741824 Jun 23 16:03:41 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:41 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.494s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:41 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Deleted volume successfully. Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df88dac1-497c-4894-a088-683757617d6e tempest-VolumesTransfersV355Test-791381202 None] Lock "cinder-8d406a7a-ad32-4e87-9cea-a8c5ef0b99de-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:41 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD" returned: 0 in 1.097s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 is fetched for user b4ea1a71c79e4c1ea2b7abe095d41347. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4dd75-bd1e-4e2c-b528-6fab772ca5a6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:42 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD Jun 23 16:03:42 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:42 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a 1073741824" returned: 0 in 1.221s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:42 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a Jun 23 16:03:42 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:43 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD" returned: 0 in 1.079s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:43 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" returned: 0 in 0.817s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-286860413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f58c5b4-ec9c-4e45-946a-1783bb710f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838d13e7c55f400ab4a15f7768509ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:40Z,use_quota=True,user_id='b4ea1a71c79e4c1ea2b7abe095d41347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Creating volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:43 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf826e-4b38-4455-a167-155349643bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06184420-a9d8-447a-8651-8fc76389b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:43 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1073741824 Jun 23 16:03:43 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:43 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Volume volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a (306a60ee-42e5-429a-ba5d-0b7a6f6c050a): created successfully Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06184420-a9d8-447a-8651-8fc76389b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (1fa85fe2-b99c-48a1-b847-bee3f79e6c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3f7f3399-f910-421a-8a17-9f37d7712924 tempest-GroupsTest-343741614 None] Created volume successfully. Jun 23 16:03:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-c817a656-98a5-4dfe-b3b3-ff769d40b6cd req-ed6ed18d-294a-4420-9c3b-c5260bc26174 tempest-TestInstancesWithCinderVolumes-350014114 None] Terminate volume connection completed successfully. Jun 23 16:03:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-c817a656-98a5-4dfe-b3b3-ff769d40b6cd req-ed6ed18d-294a-4420-9c3b-c5260bc26174 tempest-TestInstancesWithCinderVolumes-350014114 None] Deleting attachment 39b18d7a-6aae-47da-bfa2-4130c5a22974. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:03:44 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1073741824" returned: 0 in 1.274s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:44 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:03:44 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Acquiring lock "cinder-quobyte-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792fa20-1987-4631-b40a-2ab2a5953078]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:44 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a Jun 23 16:03:44 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:45 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 0.895s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Attempting download of 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-689f31e0-e362-456b-9a95-72723b358031-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-689f31e0-e362-456b-9a95-72723b358031-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dedda99-908b-455b-ac19-8e87bd6aba00]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-quobyte-689f31e0-e362-456b-9a95-72723b358031" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-689f31e0-e362-456b-9a95-72723b358031" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[15813c60-ca7f-4d2f-ba2e-b802a9178f6c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:45 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" returned: 0 in 1.060s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:45 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy Jun 23 16:03:45 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:45 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a Jun 23 16:03:45 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:46 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 Jun 23 16:03:46 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:46 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" returned: 0 in 1.106s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:46 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-306a60ee-42e5-429a-ba5d-0b7a6f6c050a" released by "delete_volume" :: held 2.231s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Created reservations ['f237a23a-de34-4639-8787-fc3451b95b72'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:47 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy" returned: 0 in 1.509s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:47 devstack cinder-volume[93590]: WARNING cinder.quota [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-660591611 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-660591611, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:47 devstack cinder-volume[93590]: WARNING cinder.quota [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-660591611 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-660591611, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Created reservations ['ed64d8c3-b015-4b27-b1e6-e8a0b1859ef6', 'b034ed7c-b7d9-4576-988a-376b563a8b2f', '984a26d5-6165-4c63-b356-421dbfa8cbbb', '0d788dff-ad56-4eec-9489-20180dbf0b2b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:47 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031" returned: 0 in 1.491s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:47 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031 Jun 23 16:03:47 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:47 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy Jun 23 16:03:47 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:47 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:47 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:48 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-689f31e0-e362-456b-9a95-72723b358031" returned: 0 in 1.036s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-689f31e0-e362-456b-9a95-72723b358031" released by "delete_volume" :: held 2.631s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:48 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.886s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8915d8ed-d6f9-46d9-900a-7a56d57c9c2a tempest-GroupsTest-343741614 None] Delete group completed successfully. Jun 23 16:03:48 devstack cinder-volume[93590]: WARNING cinder.quota [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1326984380-171178048 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1326984380-171178048, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:48 devstack cinder-volume[93590]: WARNING cinder.quota [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1326984380-171178048 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1326984380-171178048, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Created reservations ['93dfa36b-c821-4e12-b074-03357f9dafea', 'a23e1bb3-053e-4ea6-b7e4-9c5c86fc86ba', 'dde49bf9-80d2-40f8-82c4-448e983104bb', 'b2f7fa6f-f40a-4c74-97fc-10e7a4f926c1'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:48 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy" returned: 1 in 1.344s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6aac4d99-2f53-4de8-8fee-643558b40ac5_r04mh5zy' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f579254-fc74-4e7b-97a8-533eb44a0cfb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:48 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:48 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:48 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD Jun 23 16:03:48 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Created reservations ['1709aada-125e-471c-aae8-a38ddae12be0'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:48 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:48 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:49 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD" returned: 0 in 1.043s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] 6aac4d99-2f53-4de8-8fee-643558b40ac5 was qcow2, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:49 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:03:49 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:49 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.119s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Deleted volume successfully. Jun 23 16:03:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bb2205db-4949-4472-b234-eb4d84df2137 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-689f31e0-e362-456b-9a95-72723b358031-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.159s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:50 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:50 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-443b745f-f4c5-49be-b787-627291bedf01 tempest-GroupsTest-343741614 None] Delete group completed successfully. Jun 23 16:03:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7a4833a2-6d6a-44be-b7cb-19547804b8d4 tempest-GroupsTest-343741614 None] Group tempest-GroupsTest-Group-1910601605: creating Jun 23 16:03:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7a4833a2-6d6a-44be-b7cb-19547804b8d4 tempest-GroupsTest-343741614 None] Group tempest-GroupsTest-Group-1910601605: created successfully Jun 23 16:03:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7a4833a2-6d6a-44be-b7cb-19547804b8d4 tempest-GroupsTest-343741614 None] Create group completed successfully. Jun 23 16:03:51 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-e3290dcd-5f82-4779-8b18-483f18ec082d req-2a4b043b-7c99-44c8-a186-af17ca83f83d tempest-TestInstancesWithCinderVolumes-350014114 None] Terminate volume connection completed successfully. Jun 23 16:03:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-e3290dcd-5f82-4779-8b18-483f18ec082d req-2a4b043b-7c99-44c8-a186-af17ca83f83d tempest-TestInstancesWithCinderVolumes-350014114 None] Deleting attachment 79d40749-2e25-4b3c-9586-babfd77d58e8. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:03:52 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 2.534s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6aac4d99-2f53-4de8-8fee-643558b40ac5_6ospoe7adevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:03:52 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Converted 112.00 MB image at 44.18 MB/s Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:52 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1G Jun 23 16:03:52 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (f1de65f8-c948-43dc-8e2e-9aa17272e631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ffdea-2a18-4ff4-8afd-653eff7b2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ffdea-2a18-4ff4-8afd-653eff7b2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1882774677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2408ac3e-9a71-431c-8369-14955c39edc4,host='devstack@QuobyteHD#QuobyteHD',id=7b47ac83-edf8-47a7-b4b6-dbcc32a367ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:52Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69cd2bf-5a50-4929-906e-a4ba207587a5),volume_type_id=d69cd2bf-5a50-4929-906e-a4ba207587a5)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fede8b0c-7f27-4abc-9e6d-016decdf27e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fede8b0c-7f27-4abc-9e6d-016decdf27e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f5f36b-dff4-45bf-96e0-603e79c1e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f5f36b-dff4-45bf-96e0-603e79c1e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b47ac83-edf8-47a7-b4b6-dbcc32a367ac', 'volume_name': 'volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67738282-3a50-4699-8388-bfca396cb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67738282-3a50-4699-8388-bfca396cb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee8053d-55d4-49b5-90ea-f9d5584c3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Volume 7b47ac83-edf8-47a7-b4b6-dbcc32a367ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac', 'volume_size': 1} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2408ac3e-9a71-431c-8369-14955c39edc4,created_at=2026-06-23T14:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1882774677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2408ac3e-9a71-431c-8369-14955c39edc4,host='devstack@QuobyteHD#QuobyteHD',id=7b47ac83-edf8-47a7-b4b6-dbcc32a367ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:52Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69cd2bf-5a50-4929-906e-a4ba207587a5),volume_type_id=d69cd2bf-5a50-4929-906e-a4ba207587a5)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Creating volume 7b47ac83-edf8-47a7-b4b6-dbcc32a367ac {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:52 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:52 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac 1073741824 Jun 23 16:03:52 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:53 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 1G" returned: 0 in 0.895s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e51dfed-2026-4ffc-bfcf-d9a5796d045e]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:53 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:03:53 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-2ff6da06-8237-46c7-9c38-d1b81a4cd455-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-2ff6da06-8237-46c7-9c38-d1b81a4cd455-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:53 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac 1073741824" returned: 0 in 1.173s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-quobyte-2ff6da06-8237-46c7-9c38-d1b81a4cd455" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-2ff6da06-8237-46c7-9c38-d1b81a4cd455" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e2691-89b5-472a-8420-43a5e928479b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:03:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:54 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac Jun 23 16:03:54 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:54 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 Jun 23 16:03:54 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:54 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 1.034s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:54 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:03:54 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:55 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455" returned: 0 in 1.147s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:55 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455 Jun 23 16:03:55 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:55 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 1 in 1.234s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Downloaded image 6aac4d99-2f53-4de8-8fee-643558b40ac5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}])) to volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Temporary image 6aac4d99-2f53-4de8-8fee-643558b40ac5 for user b4ea1a71c79e4c1ea2b7abe095d41347 is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Marking volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Copying metadata from image 6aac4d99-2f53-4de8-8fee-643558b40ac5 to 6f58c5b4-ec9c-4e45-946a-1783bb710f99. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Creating volume glance metadata for volume 6f58c5b4-ec9c-4e45-946a-1783bb710f99 backed by image 6aac4d99-2f53-4de8-8fee-643558b40ac5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:03:55 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" returned: 0 in 1.533s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] <== create_volume: return (2837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.839s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee8053d-55d4-49b5-90ea-f9d5584c3147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d75a249-8c50-4f2c-8feb-778ee770ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Volume volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac (7b47ac83-edf8-47a7-b4b6-dbcc32a367ac): created successfully Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d75a249-8c50-4f2c-8feb-778ee770ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (f1de65f8-c948-43dc-8e2e-9aa17272e631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-21167b30-920d-473e-919c-6c8a92afb970 tempest-GroupsTest-343741614 None] Created volume successfully. Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be7aa40-2562-4f2b-b90b-f7b3f1384972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'volume_size': 1, 'image_id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6aac4d99-2f53-4de8-8fee-643558b40ac5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '18c1fb3361804d538ef2efb5701bbaab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6aac4d99-2f53-4de8-8fee-643558b40ac5', 'created_at': datetime.datetime(2026, 6, 23, 13, 44, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 13, 44, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6aac4d99-2f53-4de8-8fee-643558b40ac5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3e341b-0332-43cc-be6b-e896e29c0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Volume volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 (6f58c5b4-ec9c-4e45-946a-1783bb710f99): created successfully Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3e341b-0332-43cc-be6b-e896e29c0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Flow 'volume_create_manager' (a1f9f98a-ee6c-4e6e-89f7-c848fd11ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-85f41e20-f5a6-4e1e-9d6f-b6dc393d3e53 tempest-TestShelveInstance-1902231455 None] Created volume successfully. Jun 23 16:03:56 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2ff6da06-8237-46c7-9c38-d1b81a4cd455" returned: 0 in 0.901s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-2ff6da06-8237-46c7-9c38-d1b81a4cd455" released by "delete_volume" :: held 2.148s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:56 devstack cinder-volume[93590]: WARNING cinder.quota [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030780523-511547868 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030780523-511547868, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:56 devstack cinder-volume[93590]: WARNING cinder.quota [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030780523-511547868 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030780523-511547868, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Created reservations ['3785ec96-2bb3-477e-8476-f63c76ae1224', '975c18cf-a1a6-43fc-8f5e-e38368f78d61', 'd43391b9-5a09-4854-adc2-2caa39679e9c', 'efec825b-d548-4669-834d-a2383e8936ea'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:56 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:03:56 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (13700c04-02dc-40b0-8a44-019eaef3ca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4478cd05-9960-4d5e-8dcd-28bd8810808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4478cd05-9960-4d5e-8dcd-28bd8810808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872284923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2408ac3e-9a71-431c-8369-14955c39edc4,host='devstack@QuobyteHD#QuobyteHD',id=dcca1155-1bfc-4b88-b397-a24ba51c8950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:57Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69cd2bf-5a50-4929-906e-a4ba207587a5),volume_type_id=d69cd2bf-5a50-4929-906e-a4ba207587a5)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f3f031-b26e-4adf-9a89-ecffb4dd3946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f3f031-b26e-4adf-9a89-ecffb4dd3946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:57 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c66966f-c742-4889-bf5f-e1c6ab9a946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c66966f-c742-4889-bf5f-e1c6ab9a946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcca1155-1bfc-4b88-b397-a24ba51c8950', 'volume_name': 'volume-dcca1155-1bfc-4b88-b397-a24ba51c8950', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea46785a-3642-46d4-9468-e99d677964c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea46785a-3642-46d4-9468-e99d677964c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a085a96-c221-4214-a382-d992939f91f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:57 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Volume dcca1155-1bfc-4b88-b397-a24ba51c8950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcca1155-1bfc-4b88-b397-a24ba51c8950', 'volume_size': 1} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2408ac3e-9a71-431c-8369-14955c39edc4,created_at=2026-06-23T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872284923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2408ac3e-9a71-431c-8369-14955c39edc4,host='devstack@QuobyteHD#QuobyteHD',id=dcca1155-1bfc-4b88-b397-a24ba51c8950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6ce3717154cd383798733b52abe9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:03:57Z,use_quota=True,user_id='8838336afdc949ce9f3b238abfa9d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d69cd2bf-5a50-4929-906e-a4ba207587a5),volume_type_id=d69cd2bf-5a50-4929-906e-a4ba207587a5)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Creating volume dcca1155-1bfc-4b88-b397-a24ba51c8950 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:03:57 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.131s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:03:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Deleted volume successfully. Jun 23 16:03:57 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 1073741824 Jun 23 16:03:57 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:57 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3a9b0319-4257-445f-8604-dc147cfbfdae tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-2ff6da06-8237-46c7-9c38-d1b81a4cd455-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:03:58 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 1073741824" returned: 0 in 1.176s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:03:58 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 Jun 23 16:03:58 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:03:59 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950" returned: 0 in 1.072s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a085a96-c221-4214-a382-d992939f91f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcca1155-1bfc-4b88-b397-a24ba51c8950', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f41bb-1cdd-42e5-821d-24c029b42c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:03:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Volume volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 (dcca1155-1bfc-4b88-b397-a24ba51c8950): created successfully Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f41bb-1cdd-42e5-821d-24c029b42c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:03:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Flow 'volume_create_manager' (13700c04-02dc-40b0-8a44-019eaef3ca81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-03a056c7-8868-43c3-98e9-a21f93555244 tempest-GroupsTest-343741614 None] Created volume successfully. Jun 23 16:04:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bdb89618-4178-4a72-ad9a-b1fba5a31ed9 tempest-GroupsTest-343741614 None] Update group completed successfully. Jun 23 16:04:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fc82c983-86f0-49e6-912c-6bf9f83d35c2 tempest-GroupsTest-343741614 None] Update group completed successfully. Jun 23 16:04:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-7a59ff72-6b77-4f0b-b01a-1f70f7f8a944 req-53c19e32-2fa0-4e29-b2b6-bf08abdb71a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Terminate volume connection completed successfully. Jun 23 16:04:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-7a59ff72-6b77-4f0b-b01a-1f70f7f8a944 req-53c19e32-2fa0-4e29-b2b6-bf08abdb71a5 tempest-TestInstancesWithCinderVolumes-350014114 None] Deleting attachment 261a4c69-460e-4963-94a1-5677803f9c08. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Flow 'volume_create_manager' (f5fa43a6-9ef3-40dd-a802-2a2d2aeec477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3346793e-5177-4632-9ca2-32e3ea8234e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3346793e-5177-4632-9ca2-32e3ea8234e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1153095134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babe180-e33e-4aa0-b22f-e529ea0b80e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41262584eae0459894ba0323bf718de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:04Z,use_quota=True,user_id='e98301b8038d44028c29ab2e2f7400bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c24232-0437-4541-b09b-06565e41d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c24232-0437-4541-b09b-06565e41d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e32dd4-5222-4655-9a7c-6217cef23813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e32dd4-5222-4655-9a7c-6217cef23813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4babe180-e33e-4aa0-b22f-e529ea0b80e8', 'volume_name': 'volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6841159e-b3fe-4454-866c-ba5d471ab2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6841159e-b3fe-4454-866c-ba5d471ab2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525b530-8629-41c9-8810-d45fbc89dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:04 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8', 'volume_size': 1} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1153095134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babe180-e33e-4aa0-b22f-e529ea0b80e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41262584eae0459894ba0323bf718de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:04Z,use_quota=True,user_id='e98301b8038d44028c29ab2e2f7400bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Creating volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:04:04 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:04 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 1073741824 Jun 23 16:04:04 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Acquiring lock "cinder-quobyte-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8921e-4d69-4d7a-9975-1270f9a2ebcb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:04:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:04 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac Jun 23 16:04:04 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:05 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 1073741824" returned: 0 in 0.940s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:05 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:04:05 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:05 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" returned: 0 in 0.879s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:05 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac Jun 23 16:04:05 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:05 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:05 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:04:05 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525b530-8629-41c9-8810-d45fbc89dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30120515-fccf-4059-80f0-fa309b3cf21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:05 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Volume volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 (4babe180-e33e-4aa0-b22f-e529ea0b80e8): created successfully Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30120515-fccf-4059-80f0-fa309b3cf21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Flow 'volume_create_manager' (f5fa43a6-9ef3-40dd-a802-2a2d2aeec477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d32ffc75-f288-4240-98bb-a1927cd85f35 tempest-VolumesActionsTest-171786758 None] Created volume successfully. Jun 23 16:04:06 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" returned: 0 in 1.114s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-7b47ac83-edf8-47a7-b4b6-dbcc32a367ac" released by "delete_volume" :: held 2.050s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Acquiring lock "cinder-quobyte-dcca1155-1bfc-4b88-b397-a24ba51c8950" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-dcca1155-1bfc-4b88-b397-a24ba51c8950" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74687f6-1b52-4819-931e-d54550f00389]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:04:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:07 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.168s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:04:07 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 Jun 23 16:04:07 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97caaeb-a02c-4135-844c-655f6dbad92f]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:07 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:04:07 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-d19e45f6-1640-4db6-9a88-1a2266bbf6a3-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-d19e45f6-1640-4db6-9a88-1a2266bbf6a3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "cinder-quobyte-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[208fc33e-d7d8-43ea-9ab2-4e34458de3ba]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:04:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:08 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950" returned: 0 in 1.157s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:08 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950 Jun 23 16:04:08 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:08 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:04:08 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:09 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 1.643s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:09 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:04:09 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:09 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 1.355s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:09 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-dcca1155-1bfc-4b88-b397-a24ba51c8950" returned: 0 in 1.413s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "cinder-quobyte-dcca1155-1bfc-4b88-b397-a24ba51c8950" released by "delete_volume" :: held 2.655s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:09 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:04:09 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Created reservations ['e381d2bd-3d1d-42c9-8ce5-ebb504aa7f8b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:04:09 devstack cinder-volume[93590]: WARNING cinder.quota [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-51082690 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-51082690, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:04:09 devstack cinder-volume[93590]: WARNING cinder.quota [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-51082690 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-51082690, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Created reservations ['3487ecda-dfbe-4349-993b-2256d2d1088c', '7346e1c4-695c-4a94-8fcd-5b3320afc5a6', '8dd0fa80-851a-40e9-9b32-c06ac8ffd75d', 'de4a7eb7-80a5-4f06-8c2c-1597682a2fba'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:04:09 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Created reservations ['d75a6885-a059-4cca-bf65-74154e932d86', 'c1a7f670-26df-446b-9cf4-548c794afffe', '30f57c93-cc80-4f4b-bd31-15080edd879e', '60b25b2b-9059-4ead-9f36-d09c6ce401f3'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:10 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:04:10 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:10 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 1 in 1.662s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.383s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:10 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 1 in 1.396s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:10 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3 Jun 23 16:04:10 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb749377-223c-4278-b41e-7bae5dea55b9', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:04:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-03c08bd2-8d43-447b-9134-ecb512f6137a req-05230b68-b571-4555-a3e1-ead1b624f0b7 tempest-TestShelveInstance-1902231455 None] attachment_update completed successfully. Jun 23 16:04:11 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.837s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:04:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1acfefd6-5f01-46c3-b68c-fe476f09e5c4 tempest-GroupsTest-343741614 None] Delete group completed successfully. Jun 23 16:04:11 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" returned: 0 in 1.002s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-quobyte-d19e45f6-1640-4db6-9a88-1a2266bbf6a3" released by "delete_volume" :: held 3.865s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:11 devstack cinder-volume[93590]: WARNING cinder.quota [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763251967-1618080098 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763251967-1618080098, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:04:11 devstack cinder-volume[93590]: WARNING cinder.quota [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763251967-1618080098 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763251967-1618080098, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Created reservations ['caaa5ff5-cdfa-4e5e-87f4-b3bfa17b534f', '17b1911a-99f7-4bb8-b94c-5d07defabd0a', '140167f7-2d84-4c8c-b886-a32eddb2b0bb', 'a3acab54-985f-4670-9060-525da2b7ae0a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:12 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:04:12 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:12 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.887s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:12 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:04:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Deleted volume successfully. Jun 23 16:04:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-08c3d6bc-8b03-4c96-834f-dcb64ad67a55 tempest-TestInstancesWithCinderVolumes-350014114 None] Lock "cinder-d19e45f6-1640-4db6-9a88-1a2266bbf6a3-delete_volume" released by "delete_volume" :: held 5.152s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:21 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=116,cinder:SELECT=106,cinder:INSERT=26,cinder:DELETE=7 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:04:22 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=102,cinder:UPDATE=110,cinder:INSERT=29,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:04:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e8dbf34e-2ec9-40cb-a878-b5fb1d676198 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" by "attach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e8dbf34e-2ec9-40cb-a878-b5fb1d676198 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" acquired by "attach_volume" :: waited 0.039s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e8dbf34e-2ec9-40cb-a878-b5fb1d676198 tempest-VolumesActionsTest-171786758 None] Attaching volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8 to instance 219688be-a604-45ea-b755-b184217c85ea at mountpoint /dev/vdb on host None. Jun 23 16:04:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e8dbf34e-2ec9-40cb-a878-b5fb1d676198 tempest-VolumesActionsTest-171786758 None] Attach volume completed successfully. Jun 23 16:04:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e8dbf34e-2ec9-40cb-a878-b5fb1d676198 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" released by "attach_volume" :: held 0.199s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd41bb52-c06a-4166-8596-418518ff3633 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" by "detach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:04:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd41bb52-c06a-4166-8596-418518ff3633 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:04:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bd41bb52-c06a-4166-8596-418518ff3633 tempest-VolumesActionsTest-171786758 None] Detaching volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8 from instance 219688be-a604-45ea-b755-b184217c85ea. Jun 23 16:04:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bd41bb52-c06a-4166-8596-418518ff3633 tempest-VolumesActionsTest-171786758 None] Detach volume completed successfully. Jun 23 16:04:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd41bb52-c06a-4166-8596-418518ff3633 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:04:42 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:04:42 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (355415ea-3653-49f2-a1eb-14c50d02b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724b9af-0a78-45c7-a0ef-4ada13010f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724b9af-0a78-45c7-a0ef-4ada13010f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-782506795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec610fa-620f-4aef-9230-baeaf5ae4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:54Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d559dc-d680-4aba-8e22-492610796598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d559dc-d680-4aba-8e22-492610796598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3429cf4-6b45-4888-9b34-341a72d9a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3429cf4-6b45-4888-9b34-341a72d9a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec610fa-620f-4aef-9230-baeaf5ae4d3f', 'volume_name': 'volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9eaa93-80ae-4df1-bfc5-8225f4e999d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9eaa93-80ae-4df1-bfc5-8225f4e999d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce854d9-8516-4220-aab6-3df0d56f36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:54 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Volume 0ec610fa-620f-4aef-9230-baeaf5ae4d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f', 'volume_size': 1} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-782506795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec610fa-620f-4aef-9230-baeaf5ae4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:54Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Creating volume 0ec610fa-620f-4aef-9230-baeaf5ae4d3f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:04:54 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:04:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:54 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f 1073741824 Jun 23 16:04:54 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:55 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f 1073741824" returned: 0 in 1.114s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:55 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f Jun 23 16:04:55 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:04:56 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" returned: 0 in 0.768s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce854d9-8516-4220-aab6-3df0d56f36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a31d07-13ec-4a71-a2eb-dca626359f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Volume volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f (0ec610fa-620f-4aef-9230-baeaf5ae4d3f): created successfully Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a31d07-13ec-4a71-a2eb-dca626359f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (355415ea-3653-49f2-a1eb-14c50d02b063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3496e94a-6683-4882-95c4-ef64455855a6 tempest-VolumesListAdminTestJSON-1841995945 None] Created volume successfully. Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (a2251b90-2f82-47af-9751-7de443c37d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001ab5cb-f284-4fc2-9630-b85582444b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001ab5cb-f284-4fc2-9630-b85582444b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-933535239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ff927d-79f4-46ce-92a8-18c035dd8b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:59Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd5eefe-6a49-44c7-8568-86f173510d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd5eefe-6a49-44c7-8568-86f173510d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960ab787-f252-4a95-8006-345cf510a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960ab787-f252-4a95-8006-345cf510a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ff927d-79f4-46ce-92a8-18c035dd8b5f', 'volume_name': 'volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5240426-eef3-4a05-82d0-0a19e698608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5240426-eef3-4a05-82d0-0a19e698608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e7feb-9026-451e-a789-8f9ac94ff9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:04:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Volume 34ff927d-79f4-46ce-92a8-18c035dd8b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f', 'volume_size': 1} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-933535239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ff927d-79f4-46ce-92a8-18c035dd8b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:04:59Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Creating volume 34ff927d-79f4-46ce-92a8-18c035dd8b5f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:04:58 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:04:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:04:58 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f 1073741824 Jun 23 16:04:58 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:00 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f 1073741824" returned: 0 in 1.495s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:00 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f Jun 23 16:05:00 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-141e1bd1-1d28-43ce-bdb1-bd2672528830 req-d907ce77-7108-42e4-9445-f647245172fa tempest-TestShelveInstance-1902231455 None] Terminate volume connection completed successfully. Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-141e1bd1-1d28-43ce-bdb1-bd2672528830 req-d907ce77-7108-42e4-9445-f647245172fa tempest-TestShelveInstance-1902231455 None] Deleting attachment cb749377-223c-4278-b41e-7bae5dea55b9. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:05:01 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f" returned: 0 in 1.419s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] <== create_volume: return (2976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.978s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e7feb-9026-451e-a789-8f9ac94ff9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42445741-bff8-4335-94a8-88b9c2aafa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:01 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Volume volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f (34ff927d-79f4-46ce-92a8-18c035dd8b5f): created successfully Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42445741-bff8-4335-94a8-88b9c2aafa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (a2251b90-2f82-47af-9751-7de443c37d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-41886d96-5a97-4562-9283-a81a44a6aa00 tempest-VolumesListAdminTestJSON-1841995945 None] Created volume successfully. Jun 23 16:05:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ce55d07e-2ed0-4cd2-a8c1-393ce58279b9 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" by "attach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ce55d07e-2ed0-4cd2-a8c1-393ce58279b9 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" acquired by "attach_volume" :: waited 0.038s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ce55d07e-2ed0-4cd2-a8c1-393ce58279b9 tempest-VolumesActionsTest-171786758 None] Attaching volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8 to instance d16c39c4-7ba5-427e-b4fd-628bcaf3a568 at mountpoint /dev/vdb on host None. Jun 23 16:05:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ce55d07e-2ed0-4cd2-a8c1-393ce58279b9 tempest-VolumesActionsTest-171786758 None] Attach volume completed successfully. Jun 23 16:05:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ce55d07e-2ed0-4cd2-a8c1-393ce58279b9 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8" released by "attach_volume" :: held 0.215s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b6921bd6-e7d7-4ac3-9d1f-7157eacdc8b4 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" by "detach_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b6921bd6-e7d7-4ac3-9d1f-7157eacdc8b4 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b6921bd6-e7d7-4ac3-9d1f-7157eacdc8b4 tempest-VolumesActionsTest-171786758 None] Detaching volume 4babe180-e33e-4aa0-b22f-e529ea0b80e8 from instance d16c39c4-7ba5-427e-b4fd-628bcaf3a568. Jun 23 16:05:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b6921bd6-e7d7-4ac3-9d1f-7157eacdc8b4 tempest-VolumesActionsTest-171786758 None] Detach volume completed successfully. Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b6921bd6-e7d7-4ac3-9d1f-7157eacdc8b4 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (84a0aed5-a3c3-4129-af4a-35b31a324a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2d56c-233f-4c2d-b821-6248258c5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2d56c-233f-4c2d-b821-6248258c5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1087856579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aca98f-d035-4286-886c-40b6378b7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:03Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcf2e91-2904-49c9-8806-89f272cbbff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcf2e91-2904-49c9-8806-89f272cbbff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce6db32-1e42-40e1-8a91-03650e7d867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce6db32-1e42-40e1-8a91-03650e7d867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aca98f-d035-4286-886c-40b6378b7959', 'volume_name': 'volume-f9aca98f-d035-4286-886c-40b6378b7959', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c564e317-0b5c-4e38-8d0e-547e4f6da0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c564e317-0b5c-4e38-8d0e-547e4f6da0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6664f-dcb7-454a-a20c-ddd0ce53fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:03 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Volume f9aca98f-d035-4286-886c-40b6378b7959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aca98f-d035-4286-886c-40b6378b7959', 'volume_size': 1} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1087856579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aca98f-d035-4286-886c-40b6378b7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507782ba86dd4e27923a4d4aae9062c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:03Z,use_quota=True,user_id='855512c210e744069a2b58fc764b9094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Creating volume f9aca98f-d035-4286-886c-40b6378b7959 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:05:03 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:05:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:03 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 1073741824 Jun 23 16:05:03 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:05 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 1073741824" returned: 0 in 2.121s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:05 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 Jun 23 16:05:05 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:05 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:05:05 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:06 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959" returned: 0 in 1.169s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] <== create_volume: return (3376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.379s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6664f-dcb7-454a-a20c-ddd0ce53fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aca98f-d035-4286-886c-40b6378b7959', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57414206-81f5-4dab-b7f6-30b9105b985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Volume volume-f9aca98f-d035-4286-886c-40b6378b7959 (f9aca98f-d035-4286-886c-40b6378b7959): created successfully Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57414206-81f5-4dab-b7f6-30b9105b985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Flow 'volume_create_manager' (84a0aed5-a3c3-4129-af4a-35b31a324a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-98594644-3ed9-4f76-93f9-a022238efd8a tempest-VolumesListAdminTestJSON-1841995945 None] Created volume successfully. Jun 23 16:05:07 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.261s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:05:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:05:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:05:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Flow 'volume_create_manager' (1098652c-e6e6-43c2-9b42-7b3bcdef2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5ae6c8-779c-456d-93aa-42905b09db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5ae6c8-779c-456d-93aa-42905b09db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6171da6-6931-4e61-9440-30b56dfe1604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f10fee2de6e44e1bf1835595c8ac7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:09Z,use_quota=True,user_id='7e5c9cbcd8a14086b176b50ca0ccbc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7cca8e-836f-40db-b578-b88c8f097104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7cca8e-836f-40db-b578-b88c8f097104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b32470c-aece-4bde-a959-912e1a30a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b32470c-aece-4bde-a959-912e1a30a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6171da6-6931-4e61-9440-30b56dfe1604', 'volume_name': 'volume-e6171da6-6931-4e61-9440-30b56dfe1604', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7da3a7-adb8-411f-81f1-a5bd59cf90ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7da3a7-adb8-411f-81f1-a5bd59cf90ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d99fea-00f3-4975-b3f0-3a2efeb3eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Volume e6171da6-6931-4e61-9440-30b56dfe1604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6171da6-6931-4e61-9440-30b56dfe1604', 'volume_size': 1} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6171da6-6931-4e61-9440-30b56dfe1604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f10fee2de6e44e1bf1835595c8ac7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:09Z,use_quota=True,user_id='7e5c9cbcd8a14086b176b50ca0ccbc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Creating volume e6171da6-6931-4e61-9440-30b56dfe1604 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:05:08 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:05:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:08 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 1073741824 Jun 23 16:05:08 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:09 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 1073741824" returned: 0 in 0.994s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:09 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 Jun 23 16:05:09 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:10 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604" returned: 0 in 0.688s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.406s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d99fea-00f3-4975-b3f0-3a2efeb3eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6171da6-6931-4e61-9440-30b56dfe1604', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cad183-11cb-4fbc-a75e-510a38d5b98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Volume volume-e6171da6-6931-4e61-9440-30b56dfe1604 (e6171da6-6931-4e61-9440-30b56dfe1604): created successfully Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cad183-11cb-4fbc-a75e-510a38d5b98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Flow 'volume_create_manager' (1098652c-e6e6-43c2-9b42-7b3bcdef2507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[99259e8a-657c-4803-afb1-bd6e063f5fc1]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f9b496e7-5389-4b38-b85e-59a05fd08982 tempest-VolumesListAdminTestJSON-1084554124 None] Created volume successfully. Jun 23 16:05:10 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:05:10 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Acquiring lock "cinder-e6171da6-6931-4e61-9440-30b56dfe1604-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "cinder-e6171da6-6931-4e61-9440-30b56dfe1604-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Acquiring lock "cinder-quobyte-e6171da6-6931-4e61-9440-30b56dfe1604" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "cinder-quobyte-e6171da6-6931-4e61-9440-30b56dfe1604" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[914fe31f-1c9d-486c-8669-9a9fe3eb54f8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-f9aca98f-d035-4286-886c-40b6378b7959-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-f9aca98f-d035-4286-886c-40b6378b7959-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-quobyte-f9aca98f-d035-4286-886c-40b6378b7959" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-f9aca98f-d035-4286-886c-40b6378b7959" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:11 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 Jun 23 16:05:11 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e77ff-0e62-4313-b4b0-32a0aeb22aa3]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:11 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 Jun 23 16:05:11 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:11 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 1.015s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:11 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:05:11 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:12 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604" returned: 0 in 1.133s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:12 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604 Jun 23 16:05:12 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:12 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959" returned: 0 in 0.975s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:12 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959 Jun 23 16:05:12 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:12 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 1 in 1.027s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.099s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44039704-70cc-4ca3-9c0e-6d971cf7d9ee', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:05:12 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-ec47669f-d2f1-488d-a1e0-9475cd7e5b1f req-b528f0c8-ad33-496f-b135-233d173645b0 tempest-TestShelveInstance-1902231455 None] attachment_update completed successfully. Jun 23 16:05:13 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f9aca98f-d035-4286-886c-40b6378b7959" returned: 0 in 0.884s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-f9aca98f-d035-4286-886c-40b6378b7959" released by "delete_volume" :: held 1.938s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:13 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e6171da6-6931-4e61-9440-30b56dfe1604" returned: 0 in 1.021s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "cinder-quobyte-e6171da6-6931-4e61-9440-30b56dfe1604" released by "delete_volume" :: held 2.240s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Created reservations ['bfa53cc2-8128-45bd-b3a1-a665dec23568', 'f2985d0b-b1b0-4183-8685-80dcaa71e3af', 'c665d0a6-e1b7-41de-b70e-5400396cf97e', 'f529a100-cbc4-4e9c-b551-884e5838d508'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Created reservations ['fa88ece9-3d88-42bf-b714-5f273fb9abc9', '01040ff7-4bce-4372-9f4a-f0b07ededca2', '4644a9a0-2b41-4b36-ac04-5f93a62f1857', '2ef5522f-e4be-4c60-93f5-d621318c855e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:13 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:05:13 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:13 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:05:13 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-34ff927d-79f4-46ce-92a8-18c035dd8b5f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-34ff927d-79f4-46ce-92a8-18c035dd8b5f-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-quobyte-34ff927d-79f4-46ce-92a8-18c035dd8b5f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-34ff927d-79f4-46ce-92a8-18c035dd8b5f" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e4962-2773-4527-aa5b-8983f8064c60]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:14 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f Jun 23 16:05:14 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:14 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.148s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:05:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Deleted volume successfully. Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fb2a9a70-4ae3-49b4-8f00-eb0bcb73a5b8 tempest-VolumesListAdminTestJSON-1084554124 None] Lock "cinder-e6171da6-6931-4e61-9440-30b56dfe1604-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:14 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.280s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:05:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Deleted volume successfully. Jun 23 16:05:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ab4b026c-f4e9-4526-bdab-28e82d0fd3be tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-f9aca98f-d035-4286-886c-40b6378b7959-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:15 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f" returned: 0 in 1.109s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b961ba8c-9710-4283-96a1-3bd4078e65f2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:15 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f Jun 23 16:05:15 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:15 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:05:15 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:15 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-34ff927d-79f4-46ce-92a8-18c035dd8b5f" returned: 0 in 0.666s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-34ff927d-79f4-46ce-92a8-18c035dd8b5f" released by "delete_volume" :: held 1.876s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Created reservations ['d336ea5b-0951-48f9-8252-c551790e5136', '00f0d863-71db-4b0f-b079-b4127a0f8e8a', 'e445831f-dc2d-487b-91fd-12b7bb032554', 'cbddc61b-dc5f-4d67-bcb8-ad763d9df292'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:15 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.833s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:15 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a387d-a4aa-4250-a798-78dd4c08e2c5]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:15 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:16 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:05:16 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:16 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.668s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:16 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:05:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Deleted volume successfully. Jun 23 16:05:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b3ac68b8-c895-4b1c-ae96-0c6a45e051fe tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-34ff927d-79f4-46ce-92a8-18c035dd8b5f-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:16 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.801s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e8zdgetap.img {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:16 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e8zdgetap.img Jun 23 16:05:16 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-0ec610fa-620f-4aef-9230-baeaf5ae4d3f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-0ec610fa-620f-4aef-9230-baeaf5ae4d3f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "cinder-quobyte-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b90b0-8e2a-4798-9b3a-a6a790e77b8b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:17 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f Jun 23 16:05:17 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:18 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" returned: 0 in 1.571s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:18 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f Jun 23 16:05:18 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:20 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" returned: 0 in 1.766s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-quobyte-0ec610fa-620f-4aef-9230-baeaf5ae4d3f" released by "delete_volume" :: held 3.423s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Created reservations ['8fa26189-8627-4305-bd6a-fd541c3c6d98', '0ea64077-6a87-4920-b4e2-7969064a67da', '316710f8-ad76-430c-8a29-62211a0b1861', '7127fbf3-5b55-4f59-a219-e4fbc1de2154'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:20 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:05:20 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:23 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 2.218s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:05:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Deleted volume successfully. Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-526cbfe2-8745-4a9a-aefc-66c0f99f2955 tempest-VolumesListAdminTestJSON-1841995945 None] Lock "cinder-0ec610fa-620f-4aef-9230-baeaf5ae4d3f-delete_volume" released by "delete_volume" :: held 6.115s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:05:23 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e8zdgetap.img" returned: 0 in 6.595s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f247c-99a8-4526-8ae4-49ee153913ef]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:23 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:05:23 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:24 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 1.400s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:24 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e8zdgetap.img {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:05:24 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Converted 1024.00 MB image at 155.24 MB/s Jun 23 16:05:24 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] 91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e was raw, no need to convert to raw {{(pid=93590) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 16:05:34 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=44,cinder:SELECT=40,cinder:INSERT=16,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:05:34 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=45,cinder:UPDATE=53,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Flow 'volume_create_manager' (e7d25a9f-1240-4a7c-9c84-44b9ec907bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cd264a-c57b-4944-aca8-d1586e7839d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cd264a-c57b-4944-aca8-d1586e7839d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1316142959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dab191-440d-4b85-982a-3d9ad8069715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5c5da0b96b4f3db2aec0116302e4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:39Z,use_quota=True,user_id='8a3a9a3b323b4cd8a3ad6c63d57206f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf5532-2dcb-4c81-b473-3f51c701e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf5532-2dcb-4c81-b473-3f51c701e05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d04a34d-c5c9-4762-9215-5cc981844f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d04a34d-c5c9-4762-9215-5cc981844f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1dab191-440d-4b85-982a-3d9ad8069715', 'volume_name': 'volume-e1dab191-440d-4b85-982a-3d9ad8069715', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d619cc07-ecb3-4852-aa3b-1784ee87509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d619cc07-ecb3-4852-aa3b-1784ee87509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df99c3-3d92-41e3-939e-c5fa7dd07803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:39 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Volume e1dab191-440d-4b85-982a-3d9ad8069715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1dab191-440d-4b85-982a-3d9ad8069715', 'volume_size': 1} Jun 23 16:05:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Flow 'volume_create_manager' (ab4ea44d-05f7-4f93-a7be-f7900b4ea768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe2f3f-feaf-47e7-bca6-93df0819f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe2f3f-feaf-47e7-bca6-93df0819f01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-199135467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f14a3b1-2980-4ee5-a341-61264089175f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109431a72cf84ac5a3ae899bc3858a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:41Z,use_quota=True,user_id='8b82e78f021345c9b9b614dbd5a8a895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d16b9-6e17-4114-aef8-4d232bf76f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153d16b9-6e17-4114-aef8-4d232bf76f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9377f1-d2f3-4c37-8cfb-911acc24cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9377f1-d2f3-4c37-8cfb-911acc24cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f14a3b1-2980-4ee5-a341-61264089175f', 'volume_name': 'volume-7f14a3b1-2980-4ee5-a341-61264089175f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc027919-4858-4099-b6b4-56fb18517ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc027919-4858-4099-b6b4-56fb18517ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad3048d-7de2-4952-9855-6e27a00ad4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Volume 7f14a3b1-2980-4ee5-a341-61264089175f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f14a3b1-2980-4ee5-a341-61264089175f', 'volume_size': 1} Jun 23 16:05:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.338s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Uploaded volume to glance image-id: 91cb1ff1-f3f5-4ea6-aef4-5c57f8e2132e. {{(pid=93590) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.792s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1316142959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dab191-440d-4b85-982a-3d9ad8069715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5c5da0b96b4f3db2aec0116302e4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:39Z,use_quota=True,user_id='8a3a9a3b323b4cd8a3ad6c63d57206f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Creating volume e1dab191-440d-4b85-982a-3d9ad8069715 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:05:54 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:05:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:54 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-400405d2-be98-4a15-8ea1-d41f985249a6 tempest-VolumesActionsTest-171786758 None] Copy volume to image completed successfully. Jun 23 16:05:54 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 1073741824 Jun 23 16:05:54 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:55 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 1073741824" returned: 0 in 1.078s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:55 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 Jun 23 16:05:55 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:56 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715" returned: 0 in 0.834s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.534s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-199135467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f14a3b1-2980-4ee5-a341-61264089175f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109431a72cf84ac5a3ae899bc3858a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:05:41Z,use_quota=True,user_id='8b82e78f021345c9b9b614dbd5a8a895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Creating volume 7f14a3b1-2980-4ee5-a341-61264089175f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:05:56 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df99c3-3d92-41e3-939e-c5fa7dd07803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1dab191-440d-4b85-982a-3d9ad8069715', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:56 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f 1073741824 Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db6754-5130-4349-87bf-4f0ebf2eedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:56 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Volume volume-e1dab191-440d-4b85-982a-3d9ad8069715 (e1dab191-440d-4b85-982a-3d9ad8069715): created successfully Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81db6754-5130-4349-87bf-4f0ebf2eedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Flow 'volume_create_manager' (e7d25a9f-1240-4a7c-9c84-44b9ec907bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-12485f09-c1cf-456d-acb1-5a64dd2cddcc tempest-TestMinimumBasicScenario-1554925455 None] Created volume successfully. Jun 23 16:05:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:05:57 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f 1073741824" returned: 0 in 1.056s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:57 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f Jun 23 16:05:57 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:58 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f" returned: 0 in 0.771s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.697s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad3048d-7de2-4952-9855-6e27a00ad4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f14a3b1-2980-4ee5-a341-61264089175f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c0644-7840-4258-8a10-89bfdc3dbf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2a813-697c-4e4e-9f9e-cdb3464b5e8c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Volume volume-7f14a3b1-2980-4ee5-a341-61264089175f (7f14a3b1-2980-4ee5-a341-61264089175f): created successfully Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c0644-7840-4258-8a10-89bfdc3dbf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:05:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Flow 'volume_create_manager' (ab4ea44d-05f7-4f93-a7be-f7900b4ea768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:05:58 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-225ecc25-28d3-4f73-b09b-65407d06913e tempest-VolumesTransfersTest-1519288165 None] Created volume successfully. Jun 23 16:05:58 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:05:58 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:59 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.811s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fbacf2-e3d9-42dd-8e09-f913377e6123]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:05:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:05:59 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:05:59 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:05:59 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jun 23 16:05:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.821s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:05:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:00 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img Jun 23 16:06:00 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6d53a6d2-58ca-4b1b-b053-c3f7eff7f043 tempest-VolumesTransfersTest-1813344506 None] Transfer volume completed successfully. Jun 23 16:06:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "cinder-7f14a3b1-2980-4ee5-a341-61264089175f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-7f14a3b1-2980-4ee5-a341-61264089175f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "cinder-quobyte-7f14a3b1-2980-4ee5-a341-61264089175f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-quobyte-7f14a3b1-2980-4ee5-a341-61264089175f" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:02 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0dd35-1bef-4588-824b-3b565a11b24c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:02 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f Jun 23 16:06:02 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:03 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f" returned: 0 in 1.575s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:03 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f Jun 23 16:06:03 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:05 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7f14a3b1-2980-4ee5-a341-61264089175f" returned: 0 in 1.568s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:05 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-quobyte-7f14a3b1-2980-4ee5-a341-61264089175f" released by "delete_volume" :: held 3.242s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img" returned: 0 in 5.233s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f5b013-208c-4652-a105-e596229487a6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Created reservations ['b40d0b99-2f0c-4ccc-afef-43f71145534f', '41757479-6744-462f-8b32-cfbeb993eee9', '224162a7-576c-4d92-a803-987c639dc086', '9d3e9357-55b8-4791-a2f5-f7bbd23e764c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:05 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:05 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:05 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:05 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:05 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:05 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:06 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.680s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Deleted volume successfully. Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4e3b949c-64b3-4c5d-ab3b-62ddbb5727f5 tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-7f14a3b1-2980-4ee5-a341-61264089175f-delete_volume" released by "delete_volume" :: held 4.262s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:06 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:06:06 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Converted 1024.00 MB image at 195.63 MB/s Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] 59ec2f16-54a5-4d56-93db-bca6bfc5dea4 was raw, converting to qcow2 {{(pid=93590) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ebf0bc-2c37-4664-923d-4c065f38af09]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:06 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img Jun 23 16:06:06 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:06 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.690s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Flow 'volume_create_manager' (197dd2a0-dc69-41c4-9271-6466f3ce92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7350055-8e2f-489f-a272-458958eecd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7350055-8e2f-489f-a272-458958eecd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723420431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b100b6ab-7079-4222-bd6e-2c63fefd913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109431a72cf84ac5a3ae899bc3858a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:07Z,use_quota=True,user_id='8b82e78f021345c9b9b614dbd5a8a895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c41c0a-44cf-4f09-a588-5be9b1e575bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c41c0a-44cf-4f09-a588-5be9b1e575bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b05ca8b-62cb-426a-978b-b9d95f858ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b05ca8b-62cb-426a-978b-b9d95f858ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b100b6ab-7079-4222-bd6e-2c63fefd913f', 'volume_name': 'volume-b100b6ab-7079-4222-bd6e-2c63fefd913f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c3c9c-e852-4609-a972-4463d6a04c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c3c9c-e852-4609-a972-4463d6a04c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e77506-1236-4dc1-bf3c-272fbdf34552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Volume b100b6ab-7079-4222-bd6e-2c63fefd913f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b100b6ab-7079-4222-bd6e-2c63fefd913f', 'volume_size': 1} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:06 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img" returned: 0 in 0.776s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:07 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img Jun 23 16:06:07 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:07 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img" returned: 1 in 0.707s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:06:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img /opt/stack/data/cinder/conversion/vol_upload_oixp93tv {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:07 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img /opt/stack/data/cinder/conversion/vol_upload_oixp93tv Jun 23 16:06:07 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:08 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img /opt/stack/data/cinder/conversion/vol_upload_oixp93tv" returned: 0 in 0.632s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:08 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Image conversion details: src /opt/stack/data/cinder/conversion/4babe180-e33e-4aa0-b22f-e529ea0b80e8.temp_image.59ec2f16-54a5-4d56-93db-bca6bfc5dea4d3jnsaqy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oixp93tv {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:06:08 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 16:06:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[978bc9d6-eeac-4687-bb24-d3dc2169e70c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oixp93tv {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:08 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oixp93tv Jun 23 16:06:08 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:09 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oixp93tv" returned: 0 in 0.708s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.213s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Uploaded volume to glance image-id: 59ec2f16-54a5-4d56-93db-bca6bfc5dea4. {{(pid=93590) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 16:06:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.272s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba73df-14e7-49cf-b80d-bac9ebf983a9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b0ecc91d-8cff-4072-b0e3-64bf135dc418 tempest-VolumesActionsTest-171786758 None] Copy volume to image completed successfully. Jun 23 16:06:10 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 Jun 23 16:06:10 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:11 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715" returned: 0 in 1.003s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.034s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.575s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-723420431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b100b6ab-7079-4222-bd6e-2c63fefd913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109431a72cf84ac5a3ae899bc3858a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:07Z,use_quota=True,user_id='8b82e78f021345c9b9b614dbd5a8a895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Creating volume b100b6ab-7079-4222-bd6e-2c63fefd913f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:06:11 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:11 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f 1073741824 Jun 23 16:06:11 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-e1dab191-440d-4b85-982a-3d9ad8069715', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7a64124-8ef4-4cf1-8553-45a0911aaf7e', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:06:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-cd9e6a22-d7b8-4753-b0a3-3f7ad8ee608e req-4d73cdff-0036-4cb7-8173-1f0038539071 tempest-TestMinimumBasicScenario-1554925455 None] attachment_update completed successfully. Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Acquiring lock "cinder-quobyte-4babe180-e33e-4aa0-b22f-e529ea0b80e8" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "cinder-quobyte-4babe180-e33e-4aa0-b22f-e529ea0b80e8" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03796ff-19c4-4ed3-b9df-f9da17cc930e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:12 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:06:12 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:12 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f 1073741824" returned: 0 in 1.305s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:12 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f Jun 23 16:06:12 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:13 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 1.262s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:13 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8 Jun 23 16:06:13 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:13 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f" returned: 0 in 0.840s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e77506-1236-4dc1-bf3c-272fbdf34552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b100b6ab-7079-4222-bd6e-2c63fefd913f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d974ce7-b5a7-4fac-9c3d-bac0d56fa9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Volume volume-b100b6ab-7079-4222-bd6e-2c63fefd913f (b100b6ab-7079-4222-bd6e-2c63fefd913f): created successfully Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d974ce7-b5a7-4fac-9c3d-bac0d56fa9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Flow 'volume_create_manager' (197dd2a0-dc69-41c4-9271-6466f3ce92ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-aa9e3cbe-ddd9-4890-807b-372552bb5995 tempest-VolumesTransfersTest-1519288165 None] Created volume successfully. Jun 23 16:06:14 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4babe180-e33e-4aa0-b22f-e529ea0b80e8" returned: 0 in 0.660s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "cinder-quobyte-4babe180-e33e-4aa0-b22f-e529ea0b80e8" released by "delete_volume" :: held 1.963s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Created reservations ['4c80dc36-9159-4b41-a441-53a74aafe635', 'be426816-982a-4519-9b8e-db4641fdbc46', 'f15e8dae-723b-430c-a751-edacf2676e7e', 'a3f532ea-1cff-418b-8e68-26880d5c23c1'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:14 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:14 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "cinder-b100b6ab-7079-4222-bd6e-2c63fefd913f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-b100b6ab-7079-4222-bd6e-2c63fefd913f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "cinder-quobyte-b100b6ab-7079-4222-bd6e-2c63fefd913f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-quobyte-b100b6ab-7079-4222-bd6e-2c63fefd913f" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b2b4d-2a90-4171-8c92-7498baeef526]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:15 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.893s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Deleted volume successfully. Jun 23 16:06:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-f4a806f6-1c4d-4ac2-9cfa-94da3d7d2cc5 tempest-VolumesActionsTest-171786758 None] Lock "cinder-4babe180-e33e-4aa0-b22f-e529ea0b80e8-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:15 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f Jun 23 16:06:15 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:16 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f" returned: 0 in 0.933s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:16 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f Jun 23 16:06:16 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-a5dbc88c-1512-4e01-ad27-f290f158c93b tempest-TestShelveInstance-1902231455 None] Terminate volume connection completed successfully. Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-a5dbc88c-1512-4e01-ad27-f290f158c93b tempest-TestShelveInstance-1902231455 None] Deleting attachment 44039704-70cc-4ca3-9c0e-6d971cf7d9ee. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:06:16 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b100b6ab-7079-4222-bd6e-2c63fefd913f" returned: 0 in 0.711s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-quobyte-b100b6ab-7079-4222-bd6e-2c63fefd913f" released by "delete_volume" :: held 1.694s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Created reservations ['07a6bef6-9c3f-431f-972f-7eb97c48dc62', '43139633-5f0f-4575-a88f-abe6eb89d4ca', '0c370297-eabc-49c0-a7fb-5baad1406da7', 'b6b3206c-48eb-4444-8498-0d50148c19e7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:16 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:16 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Acquiring lock "cinder-6f58c5b4-ec9c-4e45-946a-1783bb710f99-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "cinder-6f58c5b4-ec9c-4e45-946a-1783bb710f99-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Acquiring lock "cinder-quobyte-6f58c5b4-ec9c-4e45-946a-1783bb710f99" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "cinder-quobyte-6f58c5b4-ec9c-4e45-946a-1783bb710f99" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2357f09-1a39-4526-afa0-d2b03fedd070]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:17 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:06:17 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:17 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.026s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:17 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Deleted volume successfully. Jun 23 16:06:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c09c9a8d-3747-411d-ad2e-512c5efc722b tempest-VolumesTransfersTest-1547048637 None] Lock "cinder-b100b6ab-7079-4222-bd6e-2c63fefd913f-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:18 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 1.301s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:18 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:06:18 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:19 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 1 in 1.188s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:06:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:19 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99 Jun 23 16:06:19 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:20 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6f58c5b4-ec9c-4e45-946a-1783bb710f99" returned: 0 in 0.798s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "cinder-quobyte-6f58c5b4-ec9c-4e45-946a-1783bb710f99" released by "delete_volume" :: held 3.400s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG cinder.quota [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Created reservations ['e196bb26-ad3d-4a10-a9b8-48e5715a4316', '9343025d-7ecb-44f1-9acd-5cbf7ce08130', '18e30c44-5473-4d65-af4b-8985e3c6b77c', '81170e51-5407-4344-821b-407259322acf'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:20 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:20 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:21 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.074s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:21 devstack cinder-volume[93590]: DEBUG cinder.manager [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Deleted volume successfully. Jun 23 16:06:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [req-0c63ae8c-874c-4d46-84b2-65c0840119fb req-7bfa1a13-86a6-4cb5-a388-777a100ba080 tempest-TestShelveInstance-1902231455 None] Lock "cinder-6f58c5b4-ec9c-4e45-946a-1783bb710f99-delete_volume" released by "delete_volume" :: held 4.817s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (ee774aa3-9c8c-4f7c-a13c-509bf7a362e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0f70c-a4ce-4849-b9d4-d4e8faa65038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0f70c-a4ce-4849-b9d4-d4e8faa65038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112384852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407e892-19e8-45a7-bc27-577afa43dd51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:28Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4686fc-51da-4307-af25-68c901db7361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4686fc-51da-4307-af25-68c901db7361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584acc3d-e67b-4da8-95a7-f58ebfbf6638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584acc3d-e67b-4da8-95a7-f58ebfbf6638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6407e892-19e8-45a7-bc27-577afa43dd51', 'volume_name': 'volume-6407e892-19e8-45a7-bc27-577afa43dd51', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb46016-d55b-4dce-a1c1-63f1ed2043ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb46016-d55b-4dce-a1c1-63f1ed2043ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d3e87-09a7-41e4-80a9-ad0a2174fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:27 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Volume 6407e892-19e8-45a7-bc27-577afa43dd51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6407e892-19e8-45a7-bc27-577afa43dd51', 'volume_size': 1} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112384852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6407e892-19e8-45a7-bc27-577afa43dd51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:28Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Creating volume 6407e892-19e8-45a7-bc27-577afa43dd51 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:06:27 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:06:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:27 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 1073741824 Jun 23 16:06:27 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:28 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 1073741824" returned: 0 in 1.026s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:28 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 Jun 23 16:06:28 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:29 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51" returned: 0 in 0.795s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d3e87-09a7-41e4-80a9-ad0a2174fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6407e892-19e8-45a7-bc27-577afa43dd51', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd0eb1-4f8e-4650-8998-94a5edb903f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:29 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Volume volume-6407e892-19e8-45a7-bc27-577afa43dd51 (6407e892-19e8-45a7-bc27-577afa43dd51): created successfully Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd0eb1-4f8e-4650-8998-94a5edb903f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:29 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (ee774aa3-9c8c-4f7c-a13c-509bf7a362e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-82df3817-4c3d-439c-9bcd-d2649d84e57e tempest-VolumesListTestJSON-929297460 None] Created volume successfully. Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (c90051b0-58a8-4d84-8f8a-fb0d294db485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a0e862-dff3-42df-8e0c-51479230422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a0e862-dff3-42df-8e0c-51479230422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-372432302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a28bafa-0ae8-4063-a49a-f1c1b91b9cce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:32Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d88f6a-19e5-4bb3-9b7f-e5ea5445ed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d88f6a-19e5-4bb3-9b7f-e5ea5445ed29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5457e-fec6-4b95-8adc-70832e6c69b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5457e-fec6-4b95-8adc-70832e6c69b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a28bafa-0ae8-4063-a49a-f1c1b91b9cce', 'volume_name': 'volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1ae5bb-efb4-46be-b1ed-8278581112c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1ae5bb-efb4-46be-b1ed-8278581112c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bf355b-fedf-49c9-a140-93d8229ffda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:31 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Volume 7a28bafa-0ae8-4063-a49a-f1c1b91b9cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce', 'volume_size': 1} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-372432302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a28bafa-0ae8-4063-a49a-f1c1b91b9cce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:32Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Creating volume 7a28bafa-0ae8-4063-a49a-f1c1b91b9cce {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:06:31 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:06:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:31 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce 1073741824 Jun 23 16:06:31 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:32 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce 1073741824" returned: 0 in 1.097s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:32 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce Jun 23 16:06:32 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:33 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" returned: 0 in 0.831s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bf355b-fedf-49c9-a140-93d8229ffda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbeb89a-01b4-4fe2-91e6-f14fe16a7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Volume volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce (7a28bafa-0ae8-4063-a49a-f1c1b91b9cce): created successfully Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbeb89a-01b4-4fe2-91e6-f14fe16a7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (c90051b0-58a8-4d84-8f8a-fb0d294db485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-20cd355c-ccf5-4a32-ad5f-7983f6ba1cb2 tempest-VolumesListTestJSON-929297460 None] Created volume successfully. Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=5 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=42,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=9 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (277b4450-48db-43d0-86fb-605fbd31be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf97eaa-0341-4cd1-8b0f-3b1c94aed89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf97eaa-0341-4cd1-8b0f-3b1c94aed89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281167845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c1341f-455b-465a-ab60-c5778ddba7f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:36Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315ba4b5-cad9-4d47-9add-ba17fcb5992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315ba4b5-cad9-4d47-9add-ba17fcb5992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0dd088-05ba-4b4c-973e-95ee0046f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0dd088-05ba-4b4c-973e-95ee0046f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c1341f-455b-465a-ab60-c5778ddba7f4', 'volume_name': 'volume-19c1341f-455b-465a-ab60-c5778ddba7f4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47982ae9-49b3-4116-b92b-b1bf654fb0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47982ae9-49b3-4116-b92b-b1bf654fb0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d0f457-d0e6-4bad-9f03-aaef2b47108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:36 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Volume 19c1341f-455b-465a-ab60-c5778ddba7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c1341f-455b-465a-ab60-c5778ddba7f4', 'volume_size': 1} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281167845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c1341f-455b-465a-ab60-c5778ddba7f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba02c13fb5d64f398f707b08e32facfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:06:36Z,use_quota=True,user_id='231b852bcf6a4e3ea30eb2ed555c7da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Creating volume 19c1341f-455b-465a-ab60-c5778ddba7f4 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:06:36 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:06:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:36 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 1073741824 Jun 23 16:06:36 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:37 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 1073741824" returned: 0 in 1.526s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:37 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 Jun 23 16:06:37 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:38 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4" returned: 0 in 0.979s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.586s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d0f457-d0e6-4bad-9f03-aaef2b47108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c1341f-455b-465a-ab60-c5778ddba7f4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbec142f-7186-4345-b556-3b849feb6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:06:38 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Volume volume-19c1341f-455b-465a-ab60-c5778ddba7f4 (19c1341f-455b-465a-ab60-c5778ddba7f4): created successfully Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbec142f-7186-4345-b556-3b849feb6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:06:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Flow 'volume_create_manager' (277b4450-48db-43d0-86fb-605fbd31be25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:06:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fdb9c894-32b6-4fa7-b859-b5b64ab4abb2 tempest-VolumesListTestJSON-929297460 None] Created volume successfully. Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-19c1341f-455b-465a-ab60-c5778ddba7f4-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-19c1341f-455b-465a-ab60-c5778ddba7f4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-quobyte-19c1341f-455b-465a-ab60-c5778ddba7f4" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-19c1341f-455b-465a-ab60-c5778ddba7f4" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[684baa5e-99f8-431d-99ba-98de4335f76c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:41 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 Jun 23 16:06:41 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:42 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4" returned: 0 in 1.072s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:42 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4 Jun 23 16:06:42 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:43 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-19c1341f-455b-465a-ab60-c5778ddba7f4" returned: 0 in 0.892s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-19c1341f-455b-465a-ab60-c5778ddba7f4" released by "delete_volume" :: held 2.028s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Created reservations ['69b83ecd-33be-46c8-b5e8-c3c38f0d0670', '37434803-ee77-4b6c-9378-c62a95caaa07', '1a68dcd6-047d-44d1-b32d-1d88df9cdb27', 'da44c9a7-4b1a-49f2-8517-97c0a5d0a5f2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:43 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:43 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:44 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.986s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:44 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Deleted volume successfully. Jun 23 16:06:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3d08651b-2528-4fb0-805d-3663fafa8dc5 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-19c1341f-455b-465a-ab60-c5778ddba7f4-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "cinder-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-quobyte-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b934d-0c6e-4180-8c5a-822134a77e6d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:45 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce Jun 23 16:06:45 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:46 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" returned: 0 in 1.444s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:46 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce Jun 23 16:06:46 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:47 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" returned: 0 in 1.209s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:47 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce" released by "delete_volume" :: held 2.737s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Created reservations ['048c67bc-edd9-4e07-9a32-3574c079650d', '92ddde04-a37b-41f8-915b-1c1a8e3b3b6e', 'fe9889e5-3a9c-4fe3-b16e-dd429f1b3d67', '12b69858-e126-481e-8f7d-8924a845a330'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:48 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:48 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-6407e892-19e8-45a7-bc27-577afa43dd51-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-6407e892-19e8-45a7-bc27-577afa43dd51-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "cinder-quobyte-6407e892-19e8-45a7-bc27-577afa43dd51" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:06:48 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-6407e892-19e8-45a7-bc27-577afa43dd51" acquired by "delete_volume" :: waited 0.063s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:06:49 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe74dcfa-87c3-46a7-8fdc-759b5f2891b9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:06:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:49 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 Jun 23 16:06:49 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:49 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.695s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:49 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Deleted volume successfully. Jun 23 16:06:50 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-49169a97-40e8-42ad-add4-41cf5f733bcd tempest-VolumesListTestJSON-929297460 None] Lock "cinder-7a28bafa-0ae8-4063-a49a-f1c1b91b9cce-delete_volume" released by "delete_volume" :: held 4.834s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:50 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51" returned: 0 in 1.657s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:50 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51 Jun 23 16:06:50 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:52 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6407e892-19e8-45a7-bc27-577afa43dd51" returned: 0 in 1.437s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-quobyte-6407e892-19e8-45a7-bc27-577afa43dd51" released by "delete_volume" :: held 3.171s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Created reservations ['93dca815-bdf5-4135-a774-2b619454e5f1', '750b42a6-fb70-48f0-a772-70c747be3fa6', '2f70107d-ca46-477b-aa9d-77bd1c355029', '7e1c1ddc-5401-41a7-a215-7fecb75ae147'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:06:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:06:52 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:06:52 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:06:53 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Jun 23 16:06:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.112s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:06:53 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:06:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Deleted volume successfully. Jun 23 16:06:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7148d00f-aadb-4d00-a4fb-5756bc58f979 tempest-VolumesListTestJSON-929297460 None] Lock "cinder-6407e892-19e8-45a7-bc27-577afa43dd51-delete_volume" released by "delete_volume" :: held 4.831s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Flow 'volume_create_manager' (0e225d0e-9b6e-472e-8881-58f254172ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25368596-8434-4ab5-828f-846dbcf7e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25368596-8434-4ab5-828f-846dbcf7e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-713135588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d02e7a-6ace-465d-a9f7-e7e022c60643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb019af8bca4023abf051b23f4155a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:01Z,use_quota=True,user_id='bf24f61cada74a05bd1458bafd3cff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d855d7fb-a73c-4cb4-8f74-fadcf6b92340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d855d7fb-a73c-4cb4-8f74-fadcf6b92340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a916d0a-182c-448e-a360-23f84dd2987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a916d0a-182c-448e-a360-23f84dd2987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d02e7a-6ace-465d-a9f7-e7e022c60643', 'volume_name': 'volume-91d02e7a-6ace-465d-a9f7-e7e022c60643', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd20151e-2c95-4ea7-8e15-fb8f698977e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd20151e-2c95-4ea7-8e15-fb8f698977e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dac9c3-4857-43a8-8bbf-5452d248f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Volume 91d02e7a-6ace-465d-a9f7-e7e022c60643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d02e7a-6ace-465d-a9f7-e7e022c60643', 'volume_size': 1} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-713135588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d02e7a-6ace-465d-a9f7-e7e022c60643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb019af8bca4023abf051b23f4155a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:01Z,use_quota=True,user_id='bf24f61cada74a05bd1458bafd3cff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Creating volume 91d02e7a-6ace-465d-a9f7-e7e022c60643 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:07:00 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:07:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:00 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 1073741824 Jun 23 16:07:00 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:02 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 1073741824" returned: 0 in 1.458s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:02 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 Jun 23 16:07:02 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:03 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643" returned: 0 in 0.874s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dac9c3-4857-43a8-8bbf-5452d248f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d02e7a-6ace-465d-a9f7-e7e022c60643', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d13f4b-0d49-418a-a390-c9a3ec6deb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:03 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Volume volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 (91d02e7a-6ace-465d-a9f7-e7e022c60643): created successfully Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d13f4b-0d49-418a-a390-c9a3ec6deb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Flow 'volume_create_manager' (0e225d0e-9b6e-472e-8881-58f254172ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-59fd6d54-b2cc-4219-855a-6c4b498caa7d tempest-VolumesNegativeTest-1787297991 None] Created volume successfully. Jun 23 16:07:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:07:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:07:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:07:13 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=27,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:07:13 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:07:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-389f9444-d9f5-4b66-ab38-6b001db75b57 req-cf9611f1-b5f0-473d-8885-f0c99db0851b tempest-TestMinimumBasicScenario-1554925455 None] Terminate volume connection completed successfully. Jun 23 16:07:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-389f9444-d9f5-4b66-ab38-6b001db75b57 req-cf9611f1-b5f0-473d-8885-f0c99db0851b tempest-TestMinimumBasicScenario-1554925455 None] Deleting attachment c7a64124-8ef4-4cf1-8553-45a0911aaf7e. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:07:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "cinder-e1dab191-440d-4b85-982a-3d9ad8069715-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:07:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "cinder-e1dab191-440d-4b85-982a-3d9ad8069715-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:07:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "cinder-quobyte-e1dab191-440d-4b85-982a-3d9ad8069715" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:07:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "cinder-quobyte-e1dab191-440d-4b85-982a-3d9ad8069715" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:07:22 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe323d-fc34-4397-9037-a668b26344fb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:07:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:22 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 Jun 23 16:07:22 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Flow 'volume_create_manager' (84a781ba-91ca-45e1-afb5-a09abbea690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09af12a2-aa0a-40b2-bdaf-36dd9378ee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09af12a2-aa0a-40b2-bdaf-36dd9378ee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-545679552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a52b099-76a3-42c4-8843-bf700a651eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f06c243e3348d4a757ef152c4d4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:23Z,use_quota=True,user_id='1797036b4093409090479a9e262900fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b890fb-906f-4dce-86f4-d1e205552c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b890fb-906f-4dce-86f4-d1e205552c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef58e33-fab5-4e7e-bed6-328affde7f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef58e33-fab5-4e7e-bed6-328affde7f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a52b099-76a3-42c4-8843-bf700a651eb0', 'volume_name': 'volume-0a52b099-76a3-42c4-8843-bf700a651eb0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66adec6-654f-498a-b738-807a9617fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66adec6-654f-498a-b738-807a9617fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:23 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc64bd9c-26b8-4ab1-8477-e77d0b6e8c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:23 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Volume 0a52b099-76a3-42c4-8843-bf700a651eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a52b099-76a3-42c4-8843-bf700a651eb0', 'volume_size': 1} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-545679552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a52b099-76a3-42c4-8843-bf700a651eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f06c243e3348d4a757ef152c4d4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:23Z,use_quota=True,user_id='1797036b4093409090479a9e262900fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Creating volume 0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:07:23 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715" returned: 0 in 1.675s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:23 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 1073741824 Jun 23 16:07:23 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:23 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715 Jun 23 16:07:23 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:25 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-e1dab191-440d-4b85-982a-3d9ad8069715" returned: 0 in 1.369s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "cinder-quobyte-e1dab191-440d-4b85-982a-3d9ad8069715" released by "delete_volume" :: held 3.140s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Created reservations ['626160aa-778c-4998-821a-1e70fb3bfbb8', 'b7b141d2-410d-4d71-a6aa-c88c27cbd57e', 'c4ddf183-d8da-4b0c-9c78-b0f5a411a412', 'cd374d4a-4d95-459c-9469-38cef4dbdf7a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:25 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 1073741824" returned: 0 in 2.067s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:25 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:07:25 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:26 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:07:26 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:27 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 2.135s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:27 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:07:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Deleted volume successfully. Jun 23 16:07:28 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 2.215s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] <== create_volume: return (4381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.384s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4f3ddff4-2929-40b5-8ecb-66ab5d596e36 tempest-TestMinimumBasicScenario-1554925455 None] Lock "cinder-e1dab191-440d-4b85-982a-3d9ad8069715-delete_volume" released by "delete_volume" :: held 6.226s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc64bd9c-26b8-4ab1-8477-e77d0b6e8c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a52b099-76a3-42c4-8843-bf700a651eb0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a895a2-be4c-495a-9a11-3755c842c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:28 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Volume volume-0a52b099-76a3-42c4-8843-bf700a651eb0 (0a52b099-76a3-42c4-8843-bf700a651eb0): created successfully Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a895a2-be4c-495a-9a11-3755c842c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:28 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Flow 'volume_create_manager' (84a781ba-91ca-45e1-afb5-a09abbea690f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3b414a44-1e46-41d0-b104-9453ced7f342 tempest-TestStampPattern-1219315605 None] Created volume successfully. Jun 23 16:07:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:07:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Acquiring lock "cinder-91d02e7a-6ace-465d-a9f7-e7e022c60643-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "cinder-91d02e7a-6ace-465d-a9f7-e7e022c60643-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Acquiring lock "cinder-quobyte-91d02e7a-6ace-465d-a9f7-e7e022c60643" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "cinder-quobyte-91d02e7a-6ace-465d-a9f7-e7e022c60643" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944e8a6-0164-47d1-b135-b45d8116388c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:07:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:50 devstack sudo[110180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 Jun 23 16:07:50 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:51 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643" returned: 0 in 1.197s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:51 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643 Jun 23 16:07:51 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:52 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91d02e7a-6ace-465d-a9f7-e7e022c60643" returned: 0 in 1.155s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "cinder-quobyte-91d02e7a-6ace-465d-a9f7-e7e022c60643" released by "delete_volume" :: held 2.429s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Created reservations ['bdc02650-9bb2-4787-ab54-c54969a83db0', 'e2801691-f79a-45c3-9abd-90da181ef8f5', 'c17b729d-f6e1-4f66-927d-b02d578c845a', '18f1182a-7c30-4049-b7a1-6f3c56a4381a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:52 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:07:52 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Flow 'volume_create_manager' (4c129efe-da7a-43e5-b2a2-923a767be4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f10702-2a78-447a-a537-e2550c1c51d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:53 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.189s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f10702-2a78-447a-a537-e2550c1c51d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1155229075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407193a1-2f91-466d-a6ce-6b2e6788fb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f175d33000f74f54af3dfc8adf80aea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:53Z,use_quota=True,user_id='d60a47e5d4bb439faed71c4643175c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43996f8c-b6bf-43e3-8b8f-e70118d6953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43996f8c-b6bf-43e3-8b8f-e70118d6953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f994d2a-c32d-4679-ad7b-8a324c70de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f994d2a-c32d-4679-ad7b-8a324c70de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407193a1-2f91-466d-a6ce-6b2e6788fb47', 'volume_name': 'volume-407193a1-2f91-466d-a6ce-6b2e6788fb47', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44aadd6e-6c5b-4fdf-8b51-199fde6b7b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44aadd6e-6c5b-4fdf-8b51-199fde6b7b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdc411d-c7a7-469a-b359-578ee1d91ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Volume 407193a1-2f91-466d-a6ce-6b2e6788fb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407193a1-2f91-466d-a6ce-6b2e6788fb47', 'volume_size': 1} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1155229075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407193a1-2f91-466d-a6ce-6b2e6788fb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f175d33000f74f54af3dfc8adf80aea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:53Z,use_quota=True,user_id='d60a47e5d4bb439faed71c4643175c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Creating volume 407193a1-2f91-466d-a6ce-6b2e6788fb47 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:07:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Deleted volume successfully. Jun 23 16:07:53 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 1073741824 Jun 23 16:07:53 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:53 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6dda126e-01ae-4bbc-ab22-5eeb81c0a5ce tempest-VolumesNegativeTest-1787297991 None] Lock "cinder-91d02e7a-6ace-465d-a9f7-e7e022c60643-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:07:55 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 1073741824" returned: 0 in 1.576s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:07:55 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 Jun 23 16:07:55 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (9ef57344-c8f9-4ed8-a9d9-60e028f0d6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda7bcf-5f58-4c81-809f-b93d2ac7d28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda7bcf-5f58-4c81-809f-b93d2ac7d28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122841106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1480e3c5-bd78-4c8d-98a9-1b5037cfbb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:55Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c441ba0a-18bf-4533-97d6-24144fd65d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c441ba0a-18bf-4533-97d6-24144fd65d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48dce41-b7b0-492e-96da-4743bf21b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48dce41-b7b0-492e-96da-4743bf21b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1480e3c5-bd78-4c8d-98a9-1b5037cfbb09', 'volume_name': 'volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a1e00f-70da-4db9-9081-35b9a9e9fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a1e00f-70da-4db9-9081-35b9a9e9fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919060-0f41-415d-ad7b-afcfe734ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume 1480e3c5-bd78-4c8d-98a9-1b5037cfbb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09', 'volume_size': 1} Jun 23 16:07:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:56 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47" returned: 0 in 0.793s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] <== create_volume: return (2537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.540s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122841106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1480e3c5-bd78-4c8d-98a9-1b5037cfbb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:07:55Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume 1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:07:56 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdc411d-c7a7-469a-b359-578ee1d91ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407193a1-2f91-466d-a6ce-6b2e6788fb47', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49138a3b-4dd4-41a8-adf5-385bd9c3cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:56 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 1073741824 Jun 23 16:07:56 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Volume volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 (407193a1-2f91-466d-a6ce-6b2e6788fb47): created successfully Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49138a3b-4dd4-41a8-adf5-385bd9c3cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Flow 'volume_create_manager' (4c129efe-da7a-43e5-b2a2-923a767be4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-793c478d-b94f-4f07-97be-0190a81c0f53 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Created volume successfully. Jun 23 16:07:57 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 1073741824" returned: 0 in 1.205s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:57 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 Jun 23 16:07:57 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:58 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" returned: 0 in 0.814s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919060-0f41-415d-ad7b-afcfe734ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b65839-4d7f-4f54-be93-b14b1090d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:07:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 (1480e3c5-bd78-4c8d-98a9-1b5037cfbb09): created successfully Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b65839-4d7f-4f54-be93-b14b1090d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:07:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (9ef57344-c8f9-4ed8-a9d9-60e028f0d6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:07:58 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-717c8262-1843-4663-9a59-4d883ba9ae1d tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating offline snapshot 6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 of volume 1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f12e4-0bd7-43e2-8733-f032ad772958]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:07:59 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 Jun 23 16:07:59 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:07:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:00 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" returned: 0 in 0.841s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:00 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 1G Jun 23 16:08:00 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:01 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 1G" returned: 0 in 0.897s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:01 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 Jun 23 16:08:01 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:02 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" returned: 0 in 0.916s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:02 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 is being set with open permissions: ugo+rw Jun 23 16:08:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:02 devstack sudo[110310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 Jun 23 16:08:02 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:03 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" returned: 0 in 0.722s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:03 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info Jun 23 16:08:03 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:04 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info" returned: 0 in 0.859s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:04 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info is being set with open permissions: ugo+rw Jun 23 16:08:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:04 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info Jun 23 16:08:04 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:04 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.info" returned: 0 in 0.878s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.030s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076e6fc-cacf-458b-b751-73c02c445ed0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-05e7fb82-4055-4429-9464-73bc04bfeeeb tempest-CreateVolumesFromSnapshotTest-1402458531 None] Create snapshot completed successfully Jun 23 16:08:05 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 Jun 23 16:08:05 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:05 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:05 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:06 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47" returned: 0 in 0.973s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-407193a1-2f91-466d-a6ce-6b2e6788fb47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ad7a5f8-d813-4ae8-b8b2-305cf0df637f', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:08:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-e1c54837-ae2b-42fb-aeac-229526af5815 req-7667c2c7-451a-4906-a78b-87d17a444fac tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] attachment_update completed successfully. Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (df3c9fde-892b-4e86-8226-8497584f43a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1092e1-d7d2-4d0d-9944-2e4dbf221f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:06 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.988s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1092e1-d7d2-4d0d-9944-2e4dbf221f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467166834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8660c80e-af3d-4ccb-adfe-0f8d97417883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:07Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3770a6cd-b8ac-497f-9da8-53d6279ad9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3770a6cd-b8ac-497f-9da8-53d6279ad9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d26de8a-6c47-4d8c-b975-9e7f10edb8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d26de8a-6c47-4d8c-b975-9e7f10edb8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8660c80e-af3d-4ccb-adfe-0f8d97417883', 'volume_name': 'volume-8660c80e-af3d-4ccb-adfe-0f8d97417883', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceebe95-59a8-4b58-a2ca-40fc68442258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceebe95-59a8-4b58-a2ca-40fc68442258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c680d3ca-81b1-4717-9b7b-358986e3af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume 8660c80e-af3d-4ccb-adfe-0f8d97417883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8660c80e-af3d-4ccb-adfe-0f8d97417883', 'volume_size': 1} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467166834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8660c80e-af3d-4ccb-adfe-0f8d97417883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:07Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume 8660c80e-af3d-4ccb-adfe-0f8d97417883 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:06 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:08:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:08:07 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 1073741824 Jun 23 16:08:07 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (1bf24531-c1d7-455c-baf4-6bbb67071236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d1f0b-f9bc-49bf-8a37-d8e7e93aab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d1f0b-f9bc-49bf-8a37-d8e7e93aab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741309021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:07Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78f9b8d-f95e-42a4-86dc-9079873b616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78f9b8d-f95e-42a4-86dc-9079873b616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471c9457-9203-4bae-a977-a117aac3b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471c9457-9203-4bae-a977-a117aac3b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab', 'volume_name': 'volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0131efcd-91d6-454f-a890-02a60ec06097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0131efcd-91d6-454f-a890-02a60ec06097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8077fc2b-f8b0-40d4-bad1-2f9ffcbf6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:07 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab', 'volume_size': 1} Jun 23 16:08:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (78b5a632-e2be-401d-98ff-36e2e6809c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0302cf1f-8f7d-4ace-b058-cec50138c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0302cf1f-8f7d-4ace-b058-cec50138c690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42415010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82249a64-5257-430b-8c05-acbe65fd439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:08Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ad5562-d2dc-40e8-b894-0ab032ec4b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ad5562-d2dc-40e8-b894-0ab032ec4b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bc1e2c-f44a-4569-a7a0-cc8143ba56b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bc1e2c-f44a-4569-a7a0-cc8143ba56b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82249a64-5257-430b-8c05-acbe65fd439f', 'volume_name': 'volume-82249a64-5257-430b-8c05-acbe65fd439f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d5ed0-35f2-4500-808f-a8ca1550766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d5ed0-35f2-4500-808f-a8ca1550766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528cfe4e-abaa-4ac6-916a-6999285aba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume 82249a64-5257-430b-8c05-acbe65fd439f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82249a64-5257-430b-8c05-acbe65fd439f', 'volume_size': 1} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 1073741824" returned: 0 in 1.394s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:08 devstack sudo[110720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 Jun 23 16:08:08 devstack sudo[110720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (cfdb009e-256b-443b-9eab-56b1c3c72b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fdb62b-eb97-4595-8e4c-79e0a2791710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fdb62b-eb97-4595-8e4c-79e0a2791710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609619250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f6c84-ee83-418a-94d1-e6ee8e529939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:09Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575ef443-a495-458b-a48f-4ddb28d00efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575ef443-a495-458b-a48f-4ddb28d00efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2783-1ef7-4033-bf8d-4726499a194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2783-1ef7-4033-bf8d-4726499a194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71f6c84-ee83-418a-94d1-e6ee8e529939', 'volume_name': 'volume-c71f6c84-ee83-418a-94d1-e6ee8e529939', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566983d3-fcab-47e2-a428-24ba3e24f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566983d3-fcab-47e2-a428-24ba3e24f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e93eac-a222-4766-82b4-38b711e40813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume c71f6c84-ee83-418a-94d1-e6ee8e529939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71f6c84-ee83-418a-94d1-e6ee8e529939', 'volume_size': 1} Jun 23 16:08:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (ae1ace98-b7bb-4f51-933c-9df593f242aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365535c-d357-4b9b-851a-89a60bae9b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365535c-d357-4b9b-851a-89a60bae9b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268290591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b58b48-0349-4eec-8fd2-e4be8da17afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:09Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123ab409-9a71-4b6b-b038-54579c423e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123ab409-9a71-4b6b-b038-54579c423e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61293f-a62d-4f76-9574-3ab80aaed575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61293f-a62d-4f76-9574-3ab80aaed575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b58b48-0349-4eec-8fd2-e4be8da17afc', 'volume_name': 'volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a153e01f-2b5d-46fc-90ba-c66730ab6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a153e01f-2b5d-46fc-90ba-c66730ab6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d17722e-e015-4f07-9885-3c04f30ef578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume b9b58b48-0349-4eec-8fd2-e4be8da17afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc', 'volume_size': 1} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:09 devstack sudo[110720]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883" returned: 0 in 1.059s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (2520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741309021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:07Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:09 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c680d3ca-81b1-4717-9b7b-358986e3af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8660c80e-af3d-4ccb-adfe-0f8d97417883', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack sudo[110724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab 1073741824 Jun 23 16:08:09 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0df066a-d7c7-415e-8696-ff991f13d5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:09 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 (8660c80e-af3d-4ccb-adfe-0f8d97417883): created successfully Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0df066a-d7c7-415e-8696-ff991f13d5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:09 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (df3c9fde-892b-4e86-8226-8497584f43a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-538ba61f-a3c2-423d-b7ce-3525fa771e78 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:08:10 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab 1073741824" returned: 0 in 1.007s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:10 devstack sudo[110734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab Jun 23 16:08:10 devstack sudo[110734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f3835d80-96ab-466f-97c2-a67877ac6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa1bb34-6f23-4efd-b24b-09fe6e519a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa1bb34-6f23-4efd-b24b-09fe6e519a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273826123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffc1af3-e002-45e6-b302-bd4bfc67e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:11Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9900d945-2795-43a7-bc82-ebc20747597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9900d945-2795-43a7-bc82-ebc20747597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c0b1d-f7e6-4325-a153-dacf4fe6e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91c0b1d-f7e6-4325-a153-dacf4fe6e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bffc1af3-e002-45e6-b302-bd4bfc67e030', 'volume_name': 'volume-bffc1af3-e002-45e6-b302-bd4bfc67e030', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27e16de-7fb0-4477-b316-21812f1339bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27e16de-7fb0-4477-b316-21812f1339bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbb8b36-3356-4830-b330-aa41b55512a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume bffc1af3-e002-45e6-b302-bd4bfc67e030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bffc1af3-e002-45e6-b302-bd4bfc67e030', 'volume_size': 1} Jun 23 16:08:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:11 devstack sudo[110734]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" returned: 0 in 0.748s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.984s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42415010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82249a64-5257-430b-8c05-acbe65fd439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:08Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume 82249a64-5257-430b-8c05-acbe65fd439f {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:11 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:11 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f 1073741824 Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8077fc2b-f8b0-40d4-bad1-2f9ffcbf6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:11 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a27ee-a6c5-40d7-8846-b36f2209553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:11 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab (abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab): created successfully Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05a27ee-a6c5-40d7-8846-b36f2209553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:11 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (1bf24531-c1d7-455c-baf4-6bbb67071236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-480cfda4-be06-4e15-8c1b-272808e9bbdc tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:08:12 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f 1073741824" returned: 0 in 0.953s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:12 devstack sudo[110746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f Jun 23 16:08:12 devstack sudo[110746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:13 devstack sudo[110746]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f" returned: 0 in 0.710s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609619250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f6c84-ee83-418a-94d1-e6ee8e529939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:09Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume c71f6c84-ee83-418a-94d1-e6ee8e529939 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:13 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:13 devstack sudo[110749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 1073741824 Jun 23 16:08:13 devstack sudo[110749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528cfe4e-abaa-4ac6-916a-6999285aba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82249a64-5257-430b-8c05-acbe65fd439f', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebef075-96fa-4c50-b184-6a1bb3e57038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-82249a64-5257-430b-8c05-acbe65fd439f (82249a64-5257-430b-8c05-acbe65fd439f): created successfully Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebef075-96fa-4c50-b184-6a1bb3e57038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (78b5a632-e2be-401d-98ff-36e2e6809c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-dce90220-9f0d-41f9-8472-3b232722e0a1 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:08:14 devstack sudo[110749]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 1073741824" returned: 0 in 1.021s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-af4a1e43-08f4-4b3d-bc15-25dd0b828851 req-46376abb-5bd6-4dea-9404-b5a2570ef4e5 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Terminate volume connection completed successfully. Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-af4a1e43-08f4-4b3d-bc15-25dd0b828851 req-46376abb-5bd6-4dea-9404-b5a2570ef4e5 tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Deleting attachment 5ad7a5f8-d813-4ae8-b8b2-305cf0df637f. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:14 devstack sudo[110793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 Jun 23 16:08:14 devstack sudo[110793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:14 devstack sudo[110793]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939" returned: 0 in 0.729s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.549s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268290591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b58b48-0349-4eec-8fd2-e4be8da17afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9362e15c2b7246b5af4865fef2e7d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:09Z,use_quota=True,user_id='9cdf57ce6b35492d8af6562d1b05bcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Creating volume b9b58b48-0349-4eec-8fd2-e4be8da17afc {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:14 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e93eac-a222-4766-82b4-38b711e40813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71f6c84-ee83-418a-94d1-e6ee8e529939', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:14 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc 1073741824 Jun 23 16:08:14 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696a660c-6304-4f64-a1f5-ee22c1684899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 (c71f6c84-ee83-418a-94d1-e6ee8e529939): created successfully Jun 23 16:08:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696a660c-6304-4f64-a1f5-ee22c1684899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (cfdb009e-256b-443b-9eab-56b1c3c72b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bb27cc49-1e83-45ac-9a0f-83638c51480a tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:08:15 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc 1073741824" returned: 0 in 0.964s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:16 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc Jun 23 16:08:16 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "cinder-407193a1-2f91-466d-a6ce-6b2e6788fb47-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "cinder-407193a1-2f91-466d-a6ce-6b2e6788fb47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "cinder-quobyte-407193a1-2f91-466d-a6ce-6b2e6788fb47" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "cinder-quobyte-407193a1-2f91-466d-a6ce-6b2e6788fb47" acquired by "delete_volume" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08f1fd-5ed9-4beb-93cd-fbdea197097f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:16 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 Jun 23 16:08:16 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:16 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc" returned: 0 in 0.784s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.987s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273826123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffc1af3-e002-45e6-b302-bd4bfc67e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:11Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating volume bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:16 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d17722e-e015-4f07-9885-3c04f30ef578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:16 devstack sudo[110808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 1073741824 Jun 23 16:08:16 devstack sudo[110808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f29f23e-aa3e-4eb8-8c86-c09fe39fc2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:16 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Volume volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc (b9b58b48-0349-4eec-8fd2-e4be8da17afc): created successfully Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f29f23e-aa3e-4eb8-8c86-c09fe39fc2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Flow 'volume_create_manager' (ae1ace98-b7bb-4f51-933c-9df593f242aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0cac9caa-588d-4726-8772-f15ddda70354 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created volume successfully. Jun 23 16:08:17 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47" returned: 0 in 0.869s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:17 devstack sudo[110814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47 Jun 23 16:08:17 devstack sudo[110814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-b9b58b48-0349-4eec-8fd2-e4be8da17afc-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-b9b58b48-0349-4eec-8fd2-e4be8da17afc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-b9b58b48-0349-4eec-8fd2-e4be8da17afc" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-b9b58b48-0349-4eec-8fd2-e4be8da17afc" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f5e33-8a93-4f2d-a468-3b9d2393c43f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:17 devstack sudo[110816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc Jun 23 16:08:17 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:17 devstack sudo[110808]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 1073741824" returned: 0 in 1.008s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:17 devstack sudo[110822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 Jun 23 16:08:17 devstack sudo[110822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:18 devstack sudo[110814]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-407193a1-2f91-466d-a6ce-6b2e6788fb47" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "cinder-quobyte-407193a1-2f91-466d-a6ce-6b2e6788fb47" released by "delete_volume" :: held 1.734s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Created reservations ['bdf25bcf-e00a-43e2-b0aa-ccd1425a6273', '71754d13-8b97-4672-ab53-4f10fe3beb58', '0717c653-f072-4031-b24b-319d597c0928', 'c9a9d630-538b-4a37-97f3-0898b6df149d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:18 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:18 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:18 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:18 devstack sudo[110830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc Jun 23 16:08:18 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:18 devstack sudo[110822]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030" returned: 0 in 0.939s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.588s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbb8b36-3356-4830-b330-aa41b55512a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffc1af3-e002-45e6-b302-bd4bfc67e030', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af116d-52a1-43e1-928a-6766d9b0428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe16bc5-03c2-49c6-9622-244cc032006c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:18 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 (bffc1af3-e002-45e6-b302-bd4bfc67e030): created successfully Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af116d-52a1-43e1-928a-6766d9b0428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f3835d80-96ab-466f-97c2-a67877ac6723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-59dd5db9-849c-4608-b9d0-c632ed290e60 tempest-VolumesSnapshotTestJSON-1519307005 None] Created volume successfully. Jun 23 16:08:18 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.734s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:18 devstack sudo[110834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:08:18 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:18 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Deleted volume successfully. Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-03e944c8-efbe-4601-b479-6efa7a319c1f tempest-TestServerVolumeAttachScenarioOldVersion-854493603 None] Lock "cinder-407193a1-2f91-466d-a6ce-6b2e6788fb47-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:19 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b9b58b48-0349-4eec-8fd2-e4be8da17afc" returned: 0 in 0.822s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-b9b58b48-0349-4eec-8fd2-e4be8da17afc" released by "delete_volume" :: held 1.731s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['31486cd7-3228-4f8f-8d7c-ceb2ef8aaed9', '40694f6e-1e13-4fbf-8d5e-4325c9010f12', '7e71359f-b783-40fe-9387-dd6a6693b98d', 'de98b272-43b4-4bdc-82af-df9f550ea749'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:19 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:19 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:19 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 0.986s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.049s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-0a52b099-76a3-42c4-8843-bf700a651eb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebc92574-5997-470d-94f8-efa87a05f29c', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-c71f6c84-ee83-418a-94d1-e6ee8e529939-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating offline snapshot 7408081a-098c-4b28-bed5-9abb8f868adf of volume bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-c71f6c84-ee83-418a-94d1-e6ee8e529939-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd83fb9f-df74-43c0-ab32-f0c83b2df5ee]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-c71f6c84-ee83-418a-94d1-e6ee8e529939" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-5f22aa0e-d356-44cc-bae0-8eec97240ea5 req-a235a8a0-ba2e-439e-ae11-9965ab5d2105 tempest-TestStampPattern-1219315605 None] attachment_update completed successfully. Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-c71f6c84-ee83-418a-94d1-e6ee8e529939" acquired by "delete_volume" :: waited 0.053s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a66e2b3-7018-4086-bbc0-d54c21f8c05e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:20 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 Jun 23 16:08:20 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:20 devstack sudo[110884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 Jun 23 16:08:20 devstack sudo[110884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:20 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.229s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-86eec658-07dd-4e9d-8540-a4772a0a2d74 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-b9b58b48-0349-4eec-8fd2-e4be8da17afc-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:21 devstack sudo[110884]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939" returned: 0 in 1.094s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:21 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030" returned: 0 in 1.259s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:21 devstack sudo[110964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939 Jun 23 16:08:21 devstack sudo[110964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:21 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf 1G Jun 23 16:08:21 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:22 devstack sudo[110964]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c71f6c84-ee83-418a-94d1-e6ee8e529939" returned: 0 in 0.970s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-c71f6c84-ee83-418a-94d1-e6ee8e529939" released by "delete_volume" :: held 2.131s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['fea578d5-8e29-46a7-ba99-33a0f2546172', '78085480-0de1-4283-af48-3a3d8151b06d', '311f1dff-e2d6-496b-893b-1507c23c9d23', 'a98f7663-52ef-4877-acbc-c21a5d491926'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:22 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf 1G" returned: 0 in 1.251s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:22 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:22 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf Jun 23 16:08:22 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:23 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.841s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f0b0777-ee1d-402d-b2e8-d12729b6db99 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-c71f6c84-ee83-418a-94d1-e6ee8e529939-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:23 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf" returned: 0 in 0.854s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:23 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf is being set with open permissions: ugo+rw Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:23 devstack sudo[111307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf Jun 23 16:08:23 devstack sudo[111307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-82249a64-5257-430b-8c05-acbe65fd439f-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-82249a64-5257-430b-8c05-acbe65fd439f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-82249a64-5257-430b-8c05-acbe65fd439f" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-82249a64-5257-430b-8c05-acbe65fd439f" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[167486c5-36f5-4a77-bd9a-3a82f3b1c0f7]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:23 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f Jun 23 16:08:23 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:24 devstack sudo[111307]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf" returned: 0 in 0.743s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:24 devstack sudo[111312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info Jun 23 16:08:24 devstack sudo[111312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:24 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f" returned: 0 in 0.900s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:24 devstack sudo[111318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f Jun 23 16:08:24 devstack sudo[111318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:25 devstack sudo[111312]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:25 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info is being set with open permissions: ugo+rw Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:25 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info Jun 23 16:08:25 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:25 devstack sudo[111318]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-82249a64-5257-430b-8c05-acbe65fd439f" returned: 0 in 0.739s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-82249a64-5257-430b-8c05-acbe65fd439f" released by "delete_volume" :: held 1.703s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['f2e0d297-f1c1-42a6-a345-0b6f7721f381', '04c92edb-5971-4f94-a46b-0de668780ac5', 'eb8af433-3b76-482b-8df0-93f6929de784', '33f31238-77bc-4f34-bfca-c2bd145472dd'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:25 devstack sudo[111332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:25 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:25 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.info" returned: 0 in 0.839s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.910s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9a159983-abf5-42ff-8d5e-f7b2fa356476 tempest-VolumesSnapshotTestJSON-1519307005 None] Create snapshot completed successfully Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfcead-b48e-41d4-a0fc-70f5ad303138]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:26 devstack sudo[111337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab Jun 23 16:08:26 devstack sudo[111337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:26 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.825s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:26 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1c36aedf-e924-4ff7-ba4e-2f1788863894 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-82249a64-5257-430b-8c05-acbe65fd439f-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-7408081a-098c-4b28-bed5-9abb8f868adf-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-7408081a-098c-4b28-bed5-9abb8f868adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-7408081a-098c-4b28-bed5-9abb8f868adf" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-7408081a-098c-4b28-bed5-9abb8f868adf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Deleting offline snapshot 7408081a-098c-4b28-bed5-9abb8f868adf of volume bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] snapshot_file for this snap is: volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d22a64-3561-438b-ba2f-031f34ad8881]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:27 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf Jun 23 16:08:27 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:27 devstack sudo[111337]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" returned: 0 in 1.042s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:27 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab Jun 23 16:08:27 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:27 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf" returned: 0 in 1.038s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bffc1af3-e002-45e6-b302-bd4bfc67e030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb55d2-07a1-46b4-acf5-4bda789364a8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:28 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" returned: 0 in 0.939s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab" released by "delete_volume" :: held 2.076s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['1a9eee25-f1bb-415d-9318-7ae662cb657c', 'b348cda9-fda2-4b01-8f1f-730d30de26b4', '36d96e1a-1b1f-4aa9-9657-816f5c56b909', '92eb36db-e0cf-41cd-a8a4-8d76c00268cb'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:28 devstack sudo[111351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 Jun 23 16:08:28 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:28 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:28 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:29 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.802s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:29 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030" returned: 0 in 1.113s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-72f52967-47db-4907-ac6c-456d2ca87708 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-abe5ac2e-9c94-487f-b8d9-a8fd6a93c8ab-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:29 devstack sudo[111372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf Jun 23 16:08:29 devstack sudo[111372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-8660c80e-af3d-4ccb-adfe-0f8d97417883-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-8660c80e-af3d-4ccb-adfe-0f8d97417883-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-8660c80e-af3d-4ccb-adfe-0f8d97417883" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-8660c80e-af3d-4ccb-adfe-0f8d97417883" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf48ce-c268-4da7-bd18-f125fcbf47f0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:29 devstack sudo[111374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 Jun 23 16:08:29 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:30 devstack sudo[111372]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf" returned: 0 in 0.945s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:30 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf Jun 23 16:08:30 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:30 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883" returned: 0 in 0.986s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:30 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883 Jun 23 16:08:30 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-5b04e852-dc66-4c42-9a70-ed1bf0c1b2a9 req-a8de0a08-7842-4475-a575-9f02e455e556 tempest-TestStampPattern-1219315605 None] Terminate volume connection completed successfully. Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-5b04e852-dc66-4c42-9a70-ed1bf0c1b2a9 req-a8de0a08-7842-4475-a575-9f02e455e556 tempest-TestStampPattern-1219315605 None] Deleting attachment ebc92574-5997-470d-94f8-efa87a05f29c. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:08:30 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030.7408081a-098c-4b28-bed5-9abb8f868adf" returned: 0 in 0.913s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-7408081a-098c-4b28-bed5-9abb8f868adf" released by "_delete_snapshot" :: held 4.171s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" released by "delete_snapshot" :: held 4.199s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['35260e4c-0534-4f92-a078-06023ed8997d', '8c965ae9-adc4-407c-a707-3a2d280374b2', '79525b49-3600-45d1-a9b2-9fa13e4333da', '478ee774-964b-4c5c-a723-12a386048f9f'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:31 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8660c80e-af3d-4ccb-adfe-0f8d97417883" returned: 0 in 0.774s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Delete snapshot completed successfully. Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-8660c80e-af3d-4ccb-adfe-0f8d97417883" released by "delete_volume" :: held 1.827s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-51e0ebf3-6c4e-4608-92d7-f4dbbb48c4dd tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-7408081a-098c-4b28-bed5-9abb8f868adf-delete_snapshot" released by "delete_snapshot" :: held 4.442s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['154b4bd8-485c-460e-ba47-054500c09d0a', '406aee9e-f776-4ea4-86bc-cd8745f58272', 'a08b2dd6-7e34-42b5-a2fa-d0de499046ff', '4a70112a-58dc-4f67-8aec-a223204ceec8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:31 devstack sudo[111420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:31 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleting offline snapshot 6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 of volume 1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] snapshot_file for this snap is: volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[875512a8-f1e5-47ff-a4bf-1fc54d152796]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:31 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 Jun 23 16:08:31 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:32 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.941s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:32 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0f80aae2-407f-461b-9697-736ff7cb464f tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-8660c80e-af3d-4ccb-adfe-0f8d97417883-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:32 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" returned: 0 in 1.182s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a1f6a-139d-4f61-879b-ab0a06a81754]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f76d5739-61ec-4146-bac0-8c169cd03f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d1481-7ce0-455c-9a2a-56f330b767d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065d1481-7ce0-455c-9a2a-56f330b767d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516928839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124ff89f-d97e-499a-b8cd-e58e5a503a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:33Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06a689c-c50b-45f0-b31f-a06cde1fcec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06a689c-c50b-45f0-b31f-a06cde1fcec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9080352c-dac6-4ca9-9bc8-792189cd321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9080352c-dac6-4ca9-9bc8-792189cd321b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124ff89f-d97e-499a-b8cd-e58e5a503a0c', 'volume_name': 'volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:33 devstack sudo[111429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 Jun 23 16:08:33 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2098b64-3e0f-401a-a05e-87fa1e13dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2098b64-3e0f-401a-a05e-87fa1e13dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405582fd-b778-4dea-b8ac-b93aa96c1e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Volume 124ff89f-d97e-499a-b8cd-e58e5a503a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c', 'volume_size': 1} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Creating offline snapshot 161f499f-13cf-42cb-a723-fd6ff7505a48 of volume 0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2d5019-3e8b-426f-9de4-d5cfbc462037]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:33 devstack sudo[111431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:08:33 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:33 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" returned: 0 in 1.001s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:33 devstack sudo[111440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 Jun 23 16:08:33 devstack sudo[111440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:33 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 0.887s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:33 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 1G Jun 23 16:08:33 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:34 devstack sudo[111440]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:34 devstack sudo[111451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504 Jun 23 16:08:34 devstack sudo[111451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:35 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 1G" returned: 0 in 1.056s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a52b099-76a3-42c4-8843-bf700a651eb0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:35 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a52b099-76a3-42c4-8843-bf700a651eb0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:08:35 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:35 devstack sudo[111451]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09.6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" returned: 0 in 0.800s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504" released by "_delete_snapshot" :: held 4.003s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" released by "delete_snapshot" :: held 4.038s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['c442a329-7432-4acf-b8f3-6607cf88c546', '25f11d5e-4157-4867-b499-104fe2c2b626', '04abaff9-5879-4975-8735-97b230021620', 'abc216b6-c2e0-4079-a529-c53855cae9d1'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Delete snapshot completed successfully. Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-904453f9-2961-4fa3-b886-6ca632fa290e tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-6b5ef048-2fcf-4eb3-b72f-0f0fbe151504-delete_snapshot" released by "delete_snapshot" :: held 4.255s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:35 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a52b099-76a3-42c4-8843-bf700a651eb0 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 0.904s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:35 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 is being set with open permissions: ugo+rw Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:35 devstack sudo[111460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:08:35 devstack sudo[111460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca902dbd-302c-472c-88a6-50e8da842617]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:36 devstack sudo[111462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 Jun 23 16:08:36 devstack sudo[111462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 0.785s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:36 devstack sudo[111460]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:36 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info Jun 23 16:08:36 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:37 devstack sudo[111462]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" returned: 0 in 1.056s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:37 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09 Jun 23 16:08:37 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:37 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info" returned: 0 in 0.751s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:37 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info is being set with open permissions: ugo+rw Jun 23 16:08:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:37 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info Jun 23 16:08:37 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" returned: 0 in 0.829s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:38 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-quobyte-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09" released by "delete_volume" :: held 1.972s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Created reservations ['b096557e-ca55-4fac-9e6a-ca7b6dee911e', '984e6464-532c-4415-abd5-bd6bf1c76ccc', '026e6406-5c39-4cbc-83d6-51b29d5c7454', 'edcf37e2-6b01-4b3f-924e-8ff7ae5e4c59'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:38 devstack sudo[111477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:08:38 devstack sudo[111477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:38 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.info" returned: 0 in 0.902s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.564s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.447s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-516928839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124ff89f-d97e-499a-b8cd-e58e5a503a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:33Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Creating volume 124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:38 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=103,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=10 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:08:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=106,cinder:SELECT=93,cinder:INSERT=24,cinder:DELETE=7 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:08:38 devstack sudo[111480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c 1073741824 Jun 23 16:08:38 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ce6736ab-14d7-4e93-95a2-bd3da38a5870 tempest-TestStampPattern-1219315605 None] Create snapshot completed successfully Jun 23 16:08:39 devstack sudo[111477]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.046s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:39 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:08:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Deleted volume successfully. Jun 23 16:08:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-60f65d62-6be3-4e84-9945-c88ce0f75c58 tempest-CreateVolumesFromSnapshotTest-1402458531 None] Lock "cinder-1480e3c5-bd78-4c8d-98a9-1b5037cfbb09-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:39 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c 1073741824" returned: 0 in 1.388s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:40 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:08:40 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:40 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 0.938s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405582fd-b778-4dea-b8ac-b93aa96c1e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caadb8a2-de60-40cc-98a2-2a79f2185b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Volume volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c (124ff89f-d97e-499a-b8cd-e58e5a503a0c): created successfully Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caadb8a2-de60-40cc-98a2-2a79f2185b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f76d5739-61ec-4146-bac0-8c169cd03f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fb18c76d-4c30-4c8a-9e2b-6b9a736f217f tempest-VolumesSnapshotTestJSON-1519307005 None] Created volume successfully. Jun 23 16:08:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Creating offline snapshot b8610b4b-1d37-43c5-9665-2f36a8cb27fc of volume 124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:08:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4a195-33ee-4278-9abb-defb2772207f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:41 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:08:41 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Flow 'volume_create_manager' (37fb2756-e3b2-460a-b037-f6d78f6440ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132ee41e-5553-409f-8754-de52a1fe47ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132ee41e-5553-409f-8754-de52a1fe47ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459137758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a7e32-c8bc-411a-8a19-3bb3511458e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c1cf3e8644d3694968570b0765c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:43Z,use_quota=True,user_id='8a94d44eb3804bb88db02af00779cf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdce1126-10d5-4b60-b705-09039367dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdce1126-10d5-4b60-b705-09039367dfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e6bc53-3e3b-47d5-a09c-d9f139f5abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e6bc53-3e3b-47d5-a09c-d9f139f5abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1a7e32-c8bc-411a-8a19-3bb3511458e7', 'volume_name': 'volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca18694-8d41-4790-9670-568724200f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca18694-8d41-4790-9670-568724200f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50751183-34b5-48d1-a765-313963ee18a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Volume fd1a7e32-c8bc-411a-8a19-3bb3511458e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7', 'volume_size': 1} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:42 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 0.986s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:42 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc 1G Jun 23 16:08:42 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:43 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc 1G" returned: 0 in 1.035s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:43 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:08:43 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:44 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 0.792s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:44 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc is being set with open permissions: ugo+rw Jun 23 16:08:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:44 devstack sudo[111526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:08:44 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:45 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 0.753s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:45 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info Jun 23 16:08:45 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Flow 'volume_create_manager' (a6aa8438-d0ad-4df3-b4f0-625bf8d7d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7ef0f-9c70-4f21-adb2-249c03898dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7ef0f-9c70-4f21-adb2-249c03898dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e1624a-2913-4811-b00b-07d459df62e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64f451d869c4f1b983e50fcf9fa3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:46Z,use_quota=True,user_id='acea647bf83f4b03999b6b4033db3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdc2284-ee66-4088-ae4e-e5a66b37df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdc2284-ee66-4088-ae4e-e5a66b37df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e246cdd-1e8f-4a4d-b3b3-7d489b6051da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:45 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e246cdd-1e8f-4a4d-b3b3-7d489b6051da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8e1624a-2913-4811-b00b-07d459df62e7', 'volume_name': 'volume-f8e1624a-2913-4811-b00b-07d459df62e7', 'volume_size': 1, 'image_id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ed8c21984a3ca78c93379d4f9471b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd64f451d869c4f1b983e50fcf9fa3524', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9979a89a75cb92c18a1968ba36a5bedb728997e4990317619bba61ede892bba06164e8dc6453747c26b6d1eaa7bf278e6de9019665958cd0c51282ce28ec995d', 'id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'created_at': datetime.datetime(2026, 6, 23, 14, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539beb1d-963f-4cb2-bb67-96380e7310fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539beb1d-963f-4cb2-bb67-96380e7310fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb6ce47-093e-4e5f-b124-3ef178b74304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:46 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Volume f8e1624a-2913-4811-b00b-07d459df62e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8e1624a-2913-4811-b00b-07d459df62e7', 'volume_size': 1, 'image_id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ed8c21984a3ca78c93379d4f9471b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd64f451d869c4f1b983e50fcf9fa3524', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9979a89a75cb92c18a1968ba36a5bedb728997e4990317619bba61ede892bba06164e8dc6453747c26b6d1eaa7bf278e6de9019665958cd0c51282ce28ec995d', 'id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'created_at': datetime.datetime(2026, 6, 23, 14, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8/file', 'properties': {}}, 'image_service': } Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Trying to clone f8e1624a-2913-4811-b00b-07d459df62e7 from image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:08:46 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info" returned: 0 in 0.859s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:46 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info is being set with open permissions: ugo+rw Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:46 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info Jun 23 16:08:46 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:08:46 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c08b1-320d-4ecb-9791-cb54027bd639]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:46 devstack sudo[111563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:08:46 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:47 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.info" returned: 0 in 0.818s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.366s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.381s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459137758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a7e32-c8bc-411a-8a19-3bb3511458e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c1cf3e8644d3694968570b0765c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:43Z,use_quota=True,user_id='8a94d44eb3804bb88db02af00779cf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Creating volume fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:47 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:47 devstack sudo[111568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 1073741824 Jun 23 16:08:47 devstack sudo[111568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:47 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8021c329-388b-4080-8528-91509f6521ba tempest-VolumesSnapshotTestJSON-1519307005 None] Create snapshot completed successfully Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:47 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:08:47 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:48 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 1 in 0.886s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Temporary image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 is fetched for user acea647bf83f4b03999b6b4033db3bb0. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c52ac2-c474-4b8c-9df0-bb80dd44bb35]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:48 devstack sudo[111568]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 1073741824" returned: 0 in 1.127s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:48 devstack sudo[111579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:08:48 devstack sudo[111579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:48 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:08:48 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (2fab7dec-c3b8-4470-8ad6-13ab6b9e6c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878f8fcb-d8eb-417f-a2b7-02d999318bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878f8fcb-d8eb-417f-a2b7-02d999318bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-232808856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b8610b4b-1d37-43c5-9665-2f36a8cb27fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:49Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2756d2-757c-4e9f-a267-1951f6d98bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2756d2-757c-4e9f-a267-1951f6d98bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40347a9-c528-411f-9b5e-f2fa5da09e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40347a9-c528-411f-9b5e-f2fa5da09e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7', 'volume_name': 'volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7', 'volume_size': 2, 'snapshot_id': 'b8610b4b-1d37-43c5-9665-2f36a8cb27fc'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f9b455-c7d7-4533-b07b-76c06de7b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f9b455-c7d7-4533-b07b-76c06de7b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f1b3ad-aa70-46bc-a387-57e7e93a5771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume 9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7', 'volume_size': 2, 'snapshot_id': 'b8610b4b-1d37-43c5-9665-2f36a8cb27fc'} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:49 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.864s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.132s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50751183-34b5-48d1-a765-313963ee18a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8c346f-a4b0-4123-b6d9-2fe4268e41f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating volume 9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 from snapshot b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:49 devstack sudo[111579]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 0 in 1.092s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Volume volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 (fd1a7e32-c8bc-411a-8a19-3bb3511458e7): created successfully Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8c346f-a4b0-4123-b6d9-2fe4268e41f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Flow 'volume_create_manager' (37fb2756-e3b2-460a-b037-f6d78f6440ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] snapshot: b8610b4b-1d37-43c5-9665-2f36a8cb27fc, volume: 9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a4d1d44e-7bd6-4297-a4ff-7c076f3d6130 tempest-VolumeDependencyTests-1045800466 None] Created volume successfully. Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[31256283-39c0-4b96-ad0d-328d6a7d6133]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:49 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:08:49 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:49 devstack sudo[111587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:08:49 devstack sudo[111587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:50 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 1 in 0.982s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:50 devstack sudo[111587]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 0.990s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed92a72-c00a-42cb-bf31-daf4397bbff0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:50 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:08:50 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Flow 'volume_create_manager' (9f03f3ea-4385-4a07-a616-bfb66d2d1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7217615-584a-47ac-a01e-a314ad84ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7217615-584a-47ac-a01e-a314ad84ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-46965258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c659783c-8f84-478f-868e-f03678f9a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f06c243e3348d4a757ef152c4d4ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=161f499f-13cf-42cb-a723-fd6ff7505a48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:51Z,use_quota=True,user_id='1797036b4093409090479a9e262900fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26331011-3a15-462f-abf8-c722183b5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26331011-3a15-462f-abf8-c722183b5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5b1b8-d500-4ca9-989e-8c0fe45f70dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5b1b8-d500-4ca9-989e-8c0fe45f70dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c659783c-8f84-478f-868e-f03678f9a554', 'volume_name': 'volume-c659783c-8f84-478f-868e-f03678f9a554', 'volume_size': 1, 'snapshot_id': '161f499f-13cf-42cb-a723-fd6ff7505a48'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9529749f-3433-45de-aeb5-ed58e67c78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9529749f-3433-45de-aeb5-ed58e67c78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582bdb16-430f-4137-98cf-0dc69363c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:51 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Volume c659783c-8f84-478f-868e-f03678f9a554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c659783c-8f84-478f-868e-f03678f9a554', 'volume_size': 1, 'snapshot_id': '161f499f-13cf-42cb-a723-fd6ff7505a48'} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:51 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 0.880s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:08:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:51 devstack sudo[111602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 Jun 23 16:08:51 devstack sudo[111602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:56 devstack sudo[111602]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" returned: 0 in 5.727s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cacce-cfd4-48e5-9d38-2113e4bc1be2]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:08:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:57 devstack sudo[111654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:08:57 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:57 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 0.944s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:57 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:08:57 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Converted 1024.00 MB image at 178.76 MB/s Jun 23 16:08:57 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 is being set with open permissions: ugo+rw Jun 23 16:08:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:57 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 Jun 23 16:08:57 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:58 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" returned: 0 in 0.866s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" released by "_copy_volume_from_snapshot" :: held 9.559s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" released by "_create_volume_from_snapshot" :: held 9.646s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.695s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.650s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e1624a-2913-4811-b00b-07d459df62e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64f451d869c4f1b983e50fcf9fa3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:08:46Z,use_quota=True,user_id='acea647bf83f4b03999b6b4033db3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Creating volume f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:08:58 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:08:58 devstack sudo[111668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1073741824 Jun 23 16:08:58 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:08:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f1b3ad-aa70-46bc-a387-57e7e93a5771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7', 'volume_size': 2, 'snapshot_id': 'b8610b4b-1d37-43c5-9665-2f36a8cb27fc'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fa719-d6ea-476e-a199-71c28a37f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:08:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 (9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7): created successfully Jun 23 16:08:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fa719-d6ea-476e-a199-71c28a37f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:08:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (2fab7dec-c3b8-4470-8ad6-13ab6b9e6c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:08:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7931abcf-3047-475c-87f4-bf00cb2a2443 tempest-VolumesSnapshotTestJSON-1519307005 None] Created volume successfully. Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:00 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1073741824" returned: 0 in 1.291s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" acquired by "delete_volume" :: waited 0.086s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:00 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:00 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cabc58-d0c7-4e26-9599-c70ef79529e0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:00 devstack sudo[111679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 Jun 23 16:09:00 devstack sudo[111679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:01 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 0 in 0.971s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.903s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Creating offline snapshot c6580f36-6d00-4cd0-bb12-dbb55329a002 of volume fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fa211f-b77a-4112-ad56-7db10fe58669]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Attempting download of ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}])) to volume f8e1624a-2913-4811-b00b-07d459df62e7. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5617e4-2b3c-4c91-9b37-b1077cceb9e0]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:01 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:01 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:01 devstack sudo[111687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg Jun 23 16:09:01 devstack sudo[111687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:01 devstack sudo[111679]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" returned: 0 in 1.314s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:01 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7 Jun 23 16:09:01 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:02 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 1.114s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:02 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 1G Jun 23 16:09:02 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:02 devstack sudo[111687]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg" returned: 0 in 1.076s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:02 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" returned: 0 in 0.854s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7" released by "delete_volume" :: held 2.259s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:02 devstack sudo[111718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg Jun 23 16:09:02 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['30971950-42f7-45b2-9238-c796dac5aa32', 'ccb772df-8a6c-4a59-b603-01734450aed1', 'e919a94b-5c76-49dd-b78a-68d8b7de5589', 'd7d63d06-4dc6-4325-bc32-8c357381c98a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:02 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:02 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:03 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 1G" returned: 0 in 0.969s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:03 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:03 devstack sudo[111737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:03 devstack sudo[111737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg" returned: 1 in 0.901s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_ehsyrrkg' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba1ba8-ffeb-4305-b4b9-98a1a1cef935]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:03 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:09:03 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:03 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.804s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Deleted volume successfully. Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-024a371b-f6f2-40a5-b240-dc8435006752 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-9bc7fd61-74f0-469a-a73e-d08a6bd5cdc7-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Deleting offline snapshot b8610b4b-1d37-43c5-9665-2f36a8cb27fc of volume 124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] snapshot_file for this snap is: volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b6bee-3920-407d-8cf7-8e8381d408c6]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:03 devstack sudo[111742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:09:03 devstack sudo[111742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:04 devstack sudo[111737]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 0.885s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:04 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 is being set with open permissions: ugo+rw Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:04 devstack sudo[111749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:04 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:04 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 0 in 0.901s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:04 devstack sudo[111751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD Jun 23 16:09:04 devstack sudo[111751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:04 devstack sudo[111742]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 0.928s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e8b8f2-7a06-46af-9370-3c2c3080e197]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:04 devstack sudo[111762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:09:04 devstack sudo[111762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:05 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 0.755s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:05 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info Jun 23 16:09:05 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:05 devstack sudo[111751]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD" returned: 1 in 0.866s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 was raw, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:05 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:05 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:05 devstack sudo[111762]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 0.876s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:05 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:09:05 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:05 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info" returned: 0 in 0.721s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:05 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info is being set with open permissions: ugo+rw Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:05 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info Jun 23 16:09:05 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:05 devstack sudo[111786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:05 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:06 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 0 in 0.910s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed760d15-be1a-4cd7-88ba-b38ac04aa4f8_papt8ghhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:09:06 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:06 devstack sudo[111788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1G Jun 23 16:09:06 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:06 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.info" returned: 0 in 0.746s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.348s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.400s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48-c659783c-8f84-478f-868e-f03678f9a554" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:06 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48-c659783c-8f84-478f-868e-f03678f9a554" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Creating volume c659783c-8f84-478f-868e-f03678f9a554 from snapshot 161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.802s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:06 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:09:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-867a50eb-346c-47a1-adfd-447b5ea1e863 tempest-VolumeDependencyTests-1045800466 None] Create snapshot completed successfully Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] snapshot: 161f499f-13cf-42cb-a723-fd6ff7505a48, volume: c659783c-8f84-478f-868e-f03678f9a554, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 1.082s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:06 devstack sudo[111802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc Jun 23 16:09:06 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e21af43-4e7a-488f-84af-a547d8ce1bc9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:06 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 1G" returned: 0 in 0.789s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1382aa1-59b7-4ad8-8046-939353caac92]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:06 devstack sudo[111805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:09:06 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:07 devstack sudo[111809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:07 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:07 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c.b8610b4b-1d37-43c5-9665-2f36a8cb27fc" returned: 0 in 0.943s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b8610b4b-1d37-43c5-9665-2f36a8cb27fc" released by "_delete_snapshot" :: held 4.059s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" released by "delete_snapshot" :: held 4.095s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['77a75c51-5382-4a3e-a433-699176f4b02d', 'c401b06e-1034-493f-8723-5f02d2d6bcc0', '6d202705-c6c1-455e-bab2-4c16892b0a3f', '842eccaa-fed7-403f-ae67-2ffe710ce60e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:08 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 1.264s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a52b099-76a3-42c4-8843-bf700a651eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7777227-1505-471e-b735-d14925dc9d80]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Delete snapshot completed successfully. Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-48872344-e1ac-40da-9a26-4cadd8511ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-b8610b4b-1d37-43c5-9665-2f36a8cb27fc-delete_snapshot" released by "delete_snapshot" :: held 4.507s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:08 devstack sudo[111862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:09:08 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:08 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 0 in 1.585s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Flow 'volume_create_manager' (d54df197-dada-435f-b3da-33a8b07a4079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e16858-f849-4b05-8f2a-ea9f365a872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e16858-f849-4b05-8f2a-ea9f365a872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524850462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a21db17-babf-436a-aaff-0379529771af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c1cf3e8644d3694968570b0765c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6580f36-6d00-4cd0-bb12-dbb55329a002,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:09Z,use_quota=True,user_id='8a94d44eb3804bb88db02af00779cf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eead76da-6e13-458f-9137-d849d4753522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eead76da-6e13-458f-9137-d849d4753522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0249b26-112d-4e52-a4b6-7a0c4c670fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0249b26-112d-4e52-a4b6-7a0c4c670fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a21db17-babf-436a-aaff-0379529771af', 'volume_name': 'volume-3a21db17-babf-436a-aaff-0379529771af', 'volume_size': 1, 'snapshot_id': 'c6580f36-6d00-4cd0-bb12-dbb55329a002'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9256a-7196-4069-91f2-48b5f1fec93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9256a-7196-4069-91f2-48b5f1fec93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298cac8e-a283-4f9f-a67d-4969ed1c4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:08 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Volume 3a21db17-babf-436a-aaff-0379529771af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a21db17-babf-436a-aaff-0379529771af', 'volume_size': 1, 'snapshot_id': 'c6580f36-6d00-4cd0-bb12-dbb55329a002'} Jun 23 16:09:08 devstack sudo[111866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:08 devstack sudo[111866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-124ff89f-d97e-499a-b8cd-e58e5a503a0c-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-124ff89f-d97e-499a-b8cd-e58e5a503a0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" acquired by "delete_volume" :: waited 0.044s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db43f9-bf1e-4cc9-8202-fec24f25b082]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:09 devstack sudo[111872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:09:09 devstack sudo[111872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:09 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 1.575s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:09 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 Jun 23 16:09:09 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:09 devstack sudo[111866]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 1 in 1.443s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Downloaded image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}])) to volume f8e1624a-2913-4811-b00b-07d459df62e7 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Temporary image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 for user acea647bf83f4b03999b6b4033db3bb0 is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:09:09 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Marking volume f8e1624a-2913-4811-b00b-07d459df62e7 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Copying metadata from image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 to f8e1624a-2913-4811-b00b-07d459df62e7. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Creating volume glance metadata for volume f8e1624a-2913-4811-b00b-07d459df62e7 backed by image ed760d15-be1a-4cd7-88ba-b38ac04aa4f8 with: {'image_id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8ed8c21984a3ca78c93379d4f9471b60', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb6ce47-093e-4e5f-b124-3ef178b74304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e1624a-2913-4811-b00b-07d459df62e7', 'volume_size': 1, 'image_id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ed8c21984a3ca78c93379d4f9471b60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd64f451d869c4f1b983e50fcf9fa3524', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9979a89a75cb92c18a1968ba36a5bedb728997e4990317619bba61ede892bba06164e8dc6453747c26b6d1eaa7bf278e6de9019665958cd0c51282ce28ec995d', 'id': 'ed760d15-be1a-4cd7-88ba-b38ac04aa4f8', 'created_at': datetime.datetime(2026, 6, 23, 14, 8, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 8, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed760d15-be1a-4cd7-88ba-b38ac04aa4f8/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98dab3c-31bb-46b9-a919-3d6d6a66b94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Volume volume-f8e1624a-2913-4811-b00b-07d459df62e7 (f8e1624a-2913-4811-b00b-07d459df62e7): created successfully Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98dab3c-31bb-46b9-a919-3d6d6a66b94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Flow 'volume_create_manager' (a6aa8438-d0ad-4df3-b4f0-625bf8d7d353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-efbffd70-3d33-4496-bf26-186580db5c2c tempest-VolumeImageDependencyTests-2007789551 None] Created volume successfully. Jun 23 16:09:10 devstack sudo[111872]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 1.219s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:10 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c Jun 23 16:09:10 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Acquiring lock "cinder-f8e1624a-2913-4811-b00b-07d459df62e7-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "cinder-f8e1624a-2913-4811-b00b-07d459df62e7-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Acquiring lock "cinder-quobyte-f8e1624a-2913-4811-b00b-07d459df62e7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "cinder-quobyte-f8e1624a-2913-4811-b00b-07d459df62e7" acquired by "delete_volume" :: waited 0.070s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:12 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[87774134-e5cb-4f02-a39e-0ca315161da5]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:12 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-124ff89f-d97e-499a-b8cd-e58e5a503a0c" returned: 0 in 1.808s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-124ff89f-d97e-499a-b8cd-e58e5a503a0c" released by "delete_volume" :: held 3.137s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:12 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:12 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:12 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['6d93d6ad-f3df-4c09-9a42-879663432f63', '2ce3189b-8ec9-4624-86e4-a3934cf174dc', '2afccfc3-03e4-4e3b-9c77-38bd0ba70897', '7548def2-80d0-4595-8438-fd29dee057de'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:13 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:13 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:15 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 0 in 2.977s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:15 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:15 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:15 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 2.425s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:15 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Deleted volume successfully. Jun 23 16:09:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cea19156-6466-4727-b7e6-b48213765c7e tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-124ff89f-d97e-499a-b8cd-e58e5a503a0c-delete_volume" released by "delete_volume" :: held 6.676s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (7e5327c5-1bc0-4182-ab76-409318517235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a21ab2-2471-43d1-9c5d-270104dd036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a21ab2-2471-43d1-9c5d-270104dd036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1718713923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b25ceb-6d77-4e5b-b8b1-4800a197bc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:16Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0701c6-e82c-48ab-8b99-2c3de7c481a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0701c6-e82c-48ab-8b99-2c3de7c481a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cbb363-8694-4c5d-b8c7-ed9430391130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cbb363-8694-4c5d-b8c7-ed9430391130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b25ceb-6d77-4e5b-b8b1-4800a197bc79', 'volume_name': 'volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755b0c1b-337f-4ee4-9a4c-e2656309e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755b0c1b-337f-4ee4-9a4c-e2656309e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60b4a95-ab8b-46f3-97b4-cf5674ea7764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:16 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume 91b25ceb-6d77-4e5b-b8b1-4800a197bc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79', 'volume_size': 1} Jun 23 16:09:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:18 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 1 in 2.974s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:09:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:18 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7 Jun 23 16:09:18 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:19 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554" returned: 0 in 9.688s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ff188-0082-476c-9228-5e9975c79f81]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:19 devstack sudo[111916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:09:19 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:19 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f8e1624a-2913-4811-b00b-07d459df62e7" returned: 0 in 1.763s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "cinder-quobyte-f8e1624a-2913-4811-b00b-07d459df62e7" released by "delete_volume" :: held 7.988s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Created reservations ['2cb2916a-c337-428e-9e83-d1e356b6cd06', 'fdd78f42-f7aa-4ef9-b810-f12a95d6f853', '66ef9b42-d7ae-4826-9984-ba01d18538ec', 'd039deb7-ab8f-42e9-8622-03776521dd10'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:20 devstack sudo[111919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:20 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:20 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 1.207s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:09:20 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Converted 1024.00 MB image at 105.69 MB/s Jun 23 16:09:20 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 is being set with open permissions: ugo+rw Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:20 devstack sudo[111924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 Jun 23 16:09:20 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:20 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.956s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Deleted volume successfully. Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-22d60245-b61f-424f-ac31-d9322f62b3b3 tempest-VolumeImageDependencyTests-2007789551 None] Lock "cinder-f8e1624a-2913-4811-b00b-07d459df62e7-delete_volume" released by "delete_volume" :: held 9.428s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:21 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554" returned: 0 in 0.812s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" released by "_copy_volume_from_snapshot" :: held 14.727s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48-c659783c-8f84-478f-868e-f03678f9a554" released by "_create_volume_from_snapshot" :: held 14.794s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.853s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.559s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002-3a21db17-babf-436a-aaff-0379529771af" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002-3a21db17-babf-436a-aaff-0379529771af" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Creating volume 3a21db17-babf-436a-aaff-0379529771af from snapshot c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582bdb16-430f-4137-98cf-0dc69363c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c659783c-8f84-478f-868e-f03678f9a554', 'volume_size': 1, 'snapshot_id': '161f499f-13cf-42cb-a723-fd6ff7505a48'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8d5a3a-c174-4490-8603-0cbccb585ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] snapshot: c6580f36-6d00-4cd0-bb12-dbb55329a002, volume: 3a21db17-babf-436a-aaff-0379529771af, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Volume volume-c659783c-8f84-478f-868e-f03678f9a554 (c659783c-8f84-478f-868e-f03678f9a554): created successfully Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8d5a3a-c174-4490-8603-0cbccb585ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Flow 'volume_create_manager' (9f03f3ea-4385-4a07-a616-bfb66d2d1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5975e90e-ff23-4059-acd5-b03406d9339f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4ff04a56-23ff-4ca7-a4c3-7f3d20298855 tempest-TestStampPattern-1219315605 None] Created volume successfully. Jun 23 16:09:21 devstack sudo[111931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:21 devstack sudo[111931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:22 devstack sudo[111931]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 1.098s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce768f-7910-4b7d-9aac-9c91a13eac41]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:22 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:22 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:23 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.870s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:23 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:09:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:23 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af Jun 23 16:09:23 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:29 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af" returned: 0 in 5.656s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd512cd0-de6a-4767-b8cf-c24e7ae06fcf]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:29 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:29 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:30 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:30 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:09:30 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Converted 1024.00 MB image at 181.01 MB/s Jun 23 16:09:30 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af is being set with open permissions: ugo+rw Jun 23 16:09:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:30 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af Jun 23 16:09:30 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:31 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af" returned: 0 in 0.711s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" released by "_copy_volume_from_snapshot" :: held 9.437s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002-3a21db17-babf-436a-aaff-0379529771af" released by "_create_volume_from_snapshot" :: held 9.498s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.536s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.327s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1718713923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b25ceb-6d77-4e5b-b8b1-4800a197bc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:16Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating volume 91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:31 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:31 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 1073741824 Jun 23 16:09:31 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298cac8e-a283-4f9f-a67d-4969ed1c4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a21db17-babf-436a-aaff-0379529771af', 'volume_size': 1, 'snapshot_id': 'c6580f36-6d00-4cd0-bb12-dbb55329a002'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38af135f-4c3e-4194-8254-9cb32d14da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:31 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Volume volume-3a21db17-babf-436a-aaff-0379529771af (3a21db17-babf-436a-aaff-0379529771af): created successfully Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38af135f-4c3e-4194-8254-9cb32d14da63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:31 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Flow 'volume_create_manager' (d54df197-dada-435f-b3da-33a8b07a4079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-df1cfcd8-c786-427e-be9a-8903f26c1acb tempest-VolumeDependencyTests-1045800466 None] Created volume successfully. Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-c6580f36-6d00-4cd0-bb12-dbb55329a002-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-c6580f36-6d00-4cd0-bb12-dbb55329a002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Deleting offline snapshot c6580f36-6d00-4cd0-bb12-dbb55329a002 of volume fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] snapshot_file for this snap is: volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f332199-91d4-43c6-96f6-ee462f8ed0ee]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:32 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 1073741824" returned: 0 in 1.266s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:32 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:32 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:32 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:32 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:33 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 0.722s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60b4a95-ab8b-46f3-97b4-cf5674ea7764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d235d8-221f-4050-9ae6-cce732d1fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Volume volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 (91b25ceb-6d77-4e5b-b8b1-4800a197bc79): created successfully Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d235d8-221f-4050-9ae6-cce732d1fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (7e5327c5-1bc0-4182-ab76-409318517235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-61d524d0-fd1d-44af-b98b-1cc911cb2328 tempest-VolumesSnapshotTestJSON-1519307005 None] Created volume successfully. Jun 23 16:09:33 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 1.044s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1d152-f26c-418a-9e52-c8fb5df250a3]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:33 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:33 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:34 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.882s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:34 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:34 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Creating offline snapshot b1c3ff94-497a-458c-95a4-2c4fdc46a88b of volume 91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfce70-267e-4476-b528-80e8829cae65]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:34 devstack sudo[111997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:34 devstack sudo[111997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:35 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 1.180s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:35 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002 Jun 23 16:09:35 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:36 devstack sudo[111997]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 1.499s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:36 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b 1G Jun 23 16:09:36 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:36 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7.c6580f36-6d00-4cd0-bb12-dbb55329a002" returned: 0 in 1.230s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-c6580f36-6d00-4cd0-bb12-dbb55329a002" released by "_delete_snapshot" :: held 4.507s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" released by "delete_snapshot" :: held 4.545s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Created reservations ['e30664bf-2bc8-4eb6-870d-547e293baf34', '34d32dfd-fa21-420d-b4da-598aab01586a', 'bfc26fce-2ab6-42f3-83c9-05be41af749c', '6bd1a1d1-9db5-46d8-9b19-3764021a4e8e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Delete snapshot completed successfully. Jun 23 16:09:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-4df29418-5821-42de-bdeb-f01a49c45890 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-c6580f36-6d00-4cd0-bb12-dbb55329a002-delete_snapshot" released by "delete_snapshot" :: held 4.721s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:37 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b 1G" returned: 0 in 1.065s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:37 devstack sudo[112016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:37 devstack sudo[112016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-fd1a7e32-c8bc-411a-8a19-3bb3511458e7-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-fd1a7e32-c8bc-411a-8a19-3bb3511458e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ff8001-d8af-43b7-9e13-b3b23de971d8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:37 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:37 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:37 devstack sudo[112016]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.803s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:37 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b is being set with open permissions: ugo+rw Jun 23 16:09:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:37 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:37 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:38 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.953s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:38 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7 Jun 23 16:09:38 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:38 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.959s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:DELETE=8,cinder:UPDATE=59,cinder:INSERT=17,cinder:SELECT=52 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:DELETE=6,cinder:SELECT=60,cinder:UPDATE=57,cinder:INSERT=18 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:09:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:38 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info Jun 23 16:09:38 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:39 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" returned: 0 in 0.820s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-fd1a7e32-c8bc-411a-8a19-3bb3511458e7" released by "delete_volume" :: held 1.846s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Created reservations ['04d8b549-e8f4-4e56-a563-51f141f8621b', 'a6d4d4ea-17d4-4598-864b-453c632b316c', '48a45edb-6a5b-43d4-b1de-f5beb68984c0', 'c5c79ee3-c201-40e3-94f2-84bc97d68f07'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:39 devstack sudo[112042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:39 devstack sudo[112042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:39 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info" returned: 0 in 0.730s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:39 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info is being set with open permissions: ugo+rw Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:39 devstack sudo[112044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info Jun 23 16:09:39 devstack sudo[112044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-3a21db17-babf-436a-aaff-0379529771af-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-3a21db17-babf-436a-aaff-0379529771af-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3445e-aa17-4f1f-9178-791dc9e575b4]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:40 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af Jun 23 16:09:40 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:40 devstack sudo[112042]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.865s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Deleted volume successfully. Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1d932441-11eb-4c60-acfa-4e3b60c18d53 tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-fd1a7e32-c8bc-411a-8a19-3bb3511458e7-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:40 devstack sudo[112044]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.info" returned: 0 in 0.821s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.026s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-474e4315-d7a2-49b2-9ca9-aeef094ca964 tempest-VolumesSnapshotTestJSON-1519307005 None] Create snapshot completed successfully Jun 23 16:09:40 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af" returned: 0 in 0.826s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:40 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af Jun 23 16:09:40 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f32ded9e-140f-4f83-83b8-665818ade5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a06e33c-0634-4203-97ca-db2f83ebc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a06e33c-0634-4203-97ca-db2f83ebc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1194268393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886501b3-aada-4297-b6dd-e65331e2cccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0b53d1c2c048e7886ac45aaefbe3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1c3ff94-497a-458c-95a4-2c4fdc46a88b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:42Z,use_quota=True,user_id='84ebbd6e70a240d9ae456c4431860761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272fffb4-bbdd-48e1-a9e9-130ca44ba347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272fffb4-bbdd-48e1-a9e9-130ca44ba347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cb4886-fb96-46fa-a8b2-d671630c29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cb4886-fb96-46fa-a8b2-d671630c29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '886501b3-aada-4297-b6dd-e65331e2cccb', 'volume_name': 'volume-886501b3-aada-4297-b6dd-e65331e2cccb', 'volume_size': 1, 'snapshot_id': 'b1c3ff94-497a-458c-95a4-2c4fdc46a88b'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebee26f1-2466-4e0f-af02-6b8abffa0a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebee26f1-2466-4e0f-af02-6b8abffa0a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4018942b-d6e6-4459-8d04-cbe23bb3a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Volume 886501b3-aada-4297-b6dd-e65331e2cccb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-886501b3-aada-4297-b6dd-e65331e2cccb', 'volume_size': 1, 'snapshot_id': 'b1c3ff94-497a-458c-95a4-2c4fdc46a88b'} Jun 23 16:09:41 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3a21db17-babf-436a-aaff-0379529771af" returned: 0 in 0.933s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-886501b3-aada-4297-b6dd-e65331e2cccb" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-quobyte-3a21db17-babf-436a-aaff-0379529771af" released by "delete_volume" :: held 1.818s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-886501b3-aada-4297-b6dd-e65331e2cccb" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Creating volume 886501b3-aada-4297-b6dd-e65331e2cccb from snapshot b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] snapshot: b1c3ff94-497a-458c-95a4-2c4fdc46a88b, volume: 886501b3-aada-4297-b6dd-e65331e2cccb, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f2fb1-fe8f-4805-80c0-3f951ebf22b9]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:41 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Created reservations ['df90e079-1a67-4d53-96f0-d9968df39e4f', 'c9b21b4e-e6c9-442a-bd43-ba48c50dfea9', '01d790c9-baec-46ce-9346-2a3706e87b11', 'c7900649-09e7-4fb4-aecd-a9ef05eb1020'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:42 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:42 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:42 devstack sudo[112067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:42 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:42 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.994s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61d2c8c-2ed4-4de9-a30f-570f7e57dcc8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:42 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.868s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:42 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Deleted volume successfully. Jun 23 16:09:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-eb330cf9-bdeb-4869-9561-e18a706de9cd tempest-VolumeDependencyTests-1045800466 None] Lock "cinder-3a21db17-babf-436a-aaff-0379529771af-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:43 devstack sudo[112074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:43 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:43 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 1.050s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:43 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:09:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:44 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb Jun 23 16:09:44 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Flow 'volume_create_manager' (8dbbc89f-7c49-4cc6-a09d-e5b7ee31bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6f21e6-53d9-43b7-aa58-f01cd503124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6f21e6-53d9-43b7-aa58-f01cd503124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a706d34-a888-4213-9468-e8f6e1264e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b89eaa4d1224e9fa8a11d371c83c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:48Z,use_quota=True,user_id='112058b357f2402584cb282f5e03231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110b88cd-4e50-4493-9c54-ed67c5d86a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110b88cd-4e50-4493-9c54-ed67c5d86a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d4cb7-f889-47b2-8dc9-162b9e42ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d4cb7-f889-47b2-8dc9-162b9e42ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a706d34-a888-4213-9468-e8f6e1264e03', 'volume_name': 'volume-9a706d34-a888-4213-9468-e8f6e1264e03', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa6c16-994f-4ae6-a82a-fc118be065d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa6c16-994f-4ae6-a82a-fc118be065d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9594c73d-a8c4-411f-8238-53c3dc59d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Volume 9a706d34-a888-4213-9468-e8f6e1264e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a706d34-a888-4213-9468-e8f6e1264e03', 'volume_size': 1} Jun 23 16:09:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb" returned: 0 in 6.291s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:50 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f01f3e-55fe-4a06-ac23-bd2760a06068]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:50 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:50 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:51 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 0.984s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:09:51 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Converted 1024.00 MB image at 162.72 MB/s Jun 23 16:09:51 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb is being set with open permissions: ugo+rw Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:51 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb Jun 23 16:09:51 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:51 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb" returned: 0 in 0.713s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" released by "_copy_volume_from_snapshot" :: held 10.154s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-886501b3-aada-4297-b6dd-e65331e2cccb" released by "_create_volume_from_snapshot" :: held 10.200s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.236s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.873s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[646adf3d-1f45-45b3-ae35-7a604c13303b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4018942b-d6e6-4459-8d04-cbe23bb3a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886501b3-aada-4297-b6dd-e65331e2cccb', 'volume_size': 1, 'snapshot_id': 'b1c3ff94-497a-458c-95a4-2c4fdc46a88b'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03280033-a854-43b8-92f9-7872f1618215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Volume volume-886501b3-aada-4297-b6dd-e65331e2cccb (886501b3-aada-4297-b6dd-e65331e2cccb): created successfully Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03280033-a854-43b8-92f9-7872f1618215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Flow 'volume_create_manager' (f32ded9e-140f-4f83-83b8-665818ade5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:52 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3239634c-2f81-4cee-907d-1f62db3ab6cc tempest-VolumesSnapshotTestJSON-1519307005 None] Created volume successfully. Jun 23 16:09:52 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 Jun 23 16:09:52 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-886501b3-aada-4297-b6dd-e65331e2cccb-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-886501b3-aada-4297-b6dd-e65331e2cccb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:52 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0fbb95-b46e-4410-9240-c56fd8f48038]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:53 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb Jun 23 16:09:53 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:53 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554" returned: 0 in 1.296s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.326s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.691s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a706d34-a888-4213-9468-e8f6e1264e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b89eaa4d1224e9fa8a11d371c83c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:48Z,use_quota=True,user_id='112058b357f2402584cb282f5e03231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Creating volume 9a706d34-a888-4213-9468-e8f6e1264e03 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:53 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 1073741824 Jun 23 16:09:53 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc', 'name': 'volume-c659783c-8f84-478f-868e-f03678f9a554', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf049a25-b967-4cac-abb2-59f0d4a8c464', 'enforce_multipath': True} {{(pid=93590) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 16:09:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-4d4c8147-9a47-4505-bf4d-ccc9429a252b req-7b5c23b2-1874-4779-9d69-29174952ec10 tempest-TestStampPattern-1219315605 None] attachment_update completed successfully. Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Flow 'volume_create_manager' (f6e2980a-8768-4c3f-871f-985768e604f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11229ec0-bd67-46fe-8611-36666fadf041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11229ec0-bd67-46fe-8611-36666fadf041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1498976946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c163e4-4466-4647-883a-da3a71331ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201c5ee12b7e4f45a7eb1a16bf7dd079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:54Z,use_quota=True,user_id='8bc49dcee662451688fbd70eb79e8fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:54 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599606f7-dafa-4902-b836-065b29ef195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599606f7-dafa-4902-b836-065b29ef195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5c76b8-892e-484b-bdd5-40dd17573cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5c76b8-892e-484b-bdd5-40dd17573cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c163e4-4466-4647-883a-da3a71331ee6', 'volume_name': 'volume-48c163e4-4466-4647-883a-da3a71331ee6', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf462ac-6e0d-48dd-b7a2-45f6be0de4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf462ac-6e0d-48dd-b7a2-45f6be0de4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f841f6-10e8-479a-8df1-1700294c4146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:54 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Volume 48c163e4-4466-4647-883a-da3a71331ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c163e4-4466-4647-883a-da3a71331ee6', 'volume_size': 1} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb" returned: 0 in 1.108s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:54 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb Jun 23 16:09:54 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:54 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 1073741824" returned: 0 in 1.064s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:54 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 Jun 23 16:09:54 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:54 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-886501b3-aada-4297-b6dd-e65331e2cccb" returned: 0 in 0.743s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:54 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-886501b3-aada-4297-b6dd-e65331e2cccb" released by "delete_volume" :: held 1.930s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['59c76522-b933-42c8-b471-f14310d7b34e', '7080f647-25b2-422c-8c52-0d598ff21a5c', '5e4978cf-a6df-41dd-8179-f19df664e259', '92631b3a-bcca-4446-9c05-0891deb18c78'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:55 devstack sudo[112545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:09:55 devstack sudo[112545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:55 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03" returned: 0 in 0.760s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1498976946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c163e4-4466-4647-883a-da3a71331ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201c5ee12b7e4f45a7eb1a16bf7dd079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:54Z,use_quota=True,user_id='8bc49dcee662451688fbd70eb79e8fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Creating volume 48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:55 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:55 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 1073741824 Jun 23 16:09:55 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9594c73d-a8c4-411f-8238-53c3dc59d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a706d34-a888-4213-9468-e8f6e1264e03', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd69b8a3-040a-4a94-a632-1a100682f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Volume volume-9a706d34-a888-4213-9468-e8f6e1264e03 (9a706d34-a888-4213-9468-e8f6e1264e03): created successfully Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd69b8a3-040a-4a94-a632-1a100682f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Flow 'volume_create_manager' (8dbbc89f-7c49-4cc6-a09d-e5b7ee31bb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ee51d14e-9b94-4325-bbc5-941067dbee14 tempest-CinderUnicodeTest-830324674 None] Created volume successfully. Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Deleting offline snapshot b1c3ff94-497a-458c-95a4-2c4fdc46a88b of volume 91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] snapshot_file for this snap is: volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f5f73-39e7-4141-aa55-4ca4c6247986]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:55 devstack sudo[112549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:55 devstack sudo[112549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:55 devstack sudo[112545]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.731s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:09:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Deleted volume successfully. Jun 23 16:09:55 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db8a9dd8-5872-42c7-9751-9a8cf1976055 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-886501b3-aada-4297-b6dd-e65331e2cccb-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:56 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 1073741824" returned: 0 in 1.029s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:56 devstack sudo[112549]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.840s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50517739-288e-4ec3-a438-3493eb05c5fd]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:56 devstack sudo[112560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:09:56 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:56 devstack sudo[112559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:56 devstack sudo[112559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Flow 'volume_create_manager' (443b58bc-0fb4-471b-b0dc-027f3f323777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3f6c4c-74e4-41fe-aba5-4efeed7f8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3f6c4c-74e4-41fe-aba5-4efeed7f8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1666126024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea765ec-6bd6-4361-b195-71e6ae8d2a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b89eaa4d1224e9fa8a11d371c83c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:57Z,use_quota=True,user_id='112058b357f2402584cb282f5e03231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb0173e-b1cf-4010-921a-6c0197c8732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb0173e-b1cf-4010-921a-6c0197c8732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980b7f21-661d-40be-8924-7b9a1dbab665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980b7f21-661d-40be-8924-7b9a1dbab665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea765ec-6bd6-4361-b195-71e6ae8d2a32', 'volume_name': 'volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e47390-a869-4e43-9413-1d8301aea489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e47390-a869-4e43-9413-1d8301aea489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f71320-1415-4a64-92ba-d275bd5e370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Volume 7ea765ec-6bd6-4361-b195-71e6ae8d2a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32', 'volume_size': 1} Jun 23 16:09:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:57 devstack sudo[112559]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 0.834s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:57 devstack sudo[112567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:57 devstack sudo[112567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:57 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 0.980s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:09:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1666126024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea765ec-6bd6-4361-b195-71e6ae8d2a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b89eaa4d1224e9fa8a11d371c83c0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:09:57Z,use_quota=True,user_id='112058b357f2402584cb282f5e03231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Creating volume 7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:09:57 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f841f6-10e8-479a-8df1-1700294c4146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c163e4-4466-4647-883a-da3a71331ee6', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3792cc-3e18-4321-8383-e92d00808824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:57 devstack sudo[112569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 1073741824 Jun 23 16:09:57 devstack sudo[112569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:57 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Volume volume-48c163e4-4466-4647-883a-da3a71331ee6 (48c163e4-4466-4647-883a-da3a71331ee6): created successfully Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3792cc-3e18-4321-8383-e92d00808824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Flow 'volume_create_manager' (f6e2980a-8768-4c3f-871f-985768e604f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fa484ca9-728b-42b3-a107-22f8ee9906d7 tempest-SnapshotDependencyTests-1295386181 None] Created volume successfully. Jun 23 16:09:57 devstack sudo[112567]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.793s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:57 devstack sudo[112574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b Jun 23 16:09:57 devstack sudo[112574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:58 devstack sudo[112569]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 1073741824" returned: 0 in 1.221s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:58 devstack sudo[112585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 Jun 23 16:09:58 devstack sudo[112585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:09:58 devstack sudo[112574]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79.b1c3ff94-497a-458c-95a4-2c4fdc46a88b" returned: 0 in 0.921s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-b1c3ff94-497a-458c-95a4-2c4fdc46a88b" released by "_delete_snapshot" :: held 3.513s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" released by "delete_snapshot" :: held 3.554s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:58 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['e2fcfd25-802c-4f24-95ea-5697f0e090f1', '421b54bd-87c0-41d9-9b3f-22fe7f35750a', '08f37939-78e1-41d9-8728-5528c07c305e', 'b1979279-9656-4e89-b638-2ffed9c19604'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:09:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Delete snapshot completed successfully. Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1ddca076-b109-4336-afcc-2d8833293a18 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-b1c3ff94-497a-458c-95a4-2c4fdc46a88b-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:09:59 devstack sudo[112585]: pam_unix(sudo:session): session closed for user root Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" returned: 0 in 0.833s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.772s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Creating offline snapshot cc6f7039-0bae-42e4-89ac-776961d1a76c of volume 48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f71320-1415-4a64-92ba-d275bd5e370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891e2988-61db-4a67-8dec-c9e844cd900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af2b59a-c82c-40d4-90cc-28e2592461ce]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Volume volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 (7ea765ec-6bd6-4361-b195-71e6ae8d2a32): created successfully Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891e2988-61db-4a67-8dec-c9e844cd900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Flow 'volume_create_manager' (443b58bc-0fb4-471b-b0dc-027f3f323777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:09:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-09d6f562-4d80-4c2d-bd64-e7a282dbf32e tempest-CinderUnicodeTest-830324674 None] Created volume successfully. Jun 23 16:09:59 devstack sudo[112599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:09:59 devstack sudo[112599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-91b25ceb-6d77-4e5b-b8b1-4800a197bc79-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-91b25ceb-6d77-4e5b-b8b1-4800a197bc79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c11b2c9-0919-4c77-9dae-bea96ac79007]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:09:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:09:59 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:09:59 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:00 devstack sudo[112599]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 0.904s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:00 devstack sudo[112608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c 1G Jun 23 16:10:00 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:00 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 0.916s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:00 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79 Jun 23 16:10:00 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [req-f1dcbff4-3f13-412c-91f9-97a81403e1a8 req-1e0ed89d-dc2a-4ada-8a3d-b8db36b6777a tempest-TestStampPattern-1219315605 None] Terminate volume connection completed successfully. Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [req-f1dcbff4-3f13-412c-91f9-97a81403e1a8 req-1e0ed89d-dc2a-4ada-8a3d-b8db36b6777a tempest-TestStampPattern-1219315605 None] Deleting attachment bf049a25-b967-4cac-abb2-59f0d4a8c464. {{(pid=93590) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 16:10:01 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c 1G" returned: 0 in 1.019s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c163e4-4466-4647-883a-da3a71331ee6 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:01 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c163e4-4466-4647-883a-da3a71331ee6 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:01 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:01 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" returned: 0 in 0.778s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-91b25ceb-6d77-4e5b-b8b1-4800a197bc79" released by "delete_volume" :: held 1.770s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['7e034df8-57a0-4bf1-b171-d6e6d040b8f3', '128dfeeb-32a2-4049-a1bd-4e56d4eae5d1', '17fc6e66-9354-4372-8055-fe540f38eeb5', '2fba6a8f-6d5b-4edc-9665-1c9c59bf2cf3'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:01 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:01 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-bffc1af3-e002-45e6-b302-bd4bfc67e030-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-bffc1af3-e002-45e6-b302-bd4bfc67e030-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" acquired by "delete_volume" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:02 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c163e4-4466-4647-883a-da3a71331ee6 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:02 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c is being set with open permissions: ugo+rw Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ab8e4-1c8c-46ea-a20e-c05558e2a08a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:02 devstack sudo[112674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:02 devstack sudo[112674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:02 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 Jun 23 16:10:02 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:02 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.739s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Deleted volume successfully. Jun 23 16:10:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c3b403e7-b2a2-42dc-b2cd-d455e8180ba7 tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-91b25ceb-6d77-4e5b-b8b1-4800a197bc79-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:03 devstack sudo[112674]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 0.810s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:03 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info Jun 23 16:10:03 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:03 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030" returned: 0 in 0.935s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:03 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030 Jun 23 16:10:03 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:04 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info" returned: 0 in 0.930s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:04 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info is being set with open permissions: ugo+rw Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:04 devstack sudo[112691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info Jun 23 16:10:04 devstack sudo[112691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:04 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bffc1af3-e002-45e6-b302-bd4bfc67e030" returned: 0 in 0.930s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-quobyte-bffc1af3-e002-45e6-b302-bd4bfc67e030" released by "delete_volume" :: held 1.973s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Created reservations ['77bf49da-535e-4692-9241-b5bfb26594ed', '774285b0-b146-4796-ba1b-98e620383d6c', 'b011b84a-c467-4dbe-9f80-37e75bed13a5', 'a4c99ba4-6e94-4c20-8b55-4b32d5341303'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:04 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:04 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:04 devstack sudo[112691]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.info" returned: 0 in 0.756s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.435s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Creating offline snapshot c115369e-e6e3-4d3d-82c8-fb429f5c390d of volume 7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:10:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0f4dbec3-8212-4a2d-8c50-156f9335572b tempest-SnapshotDependencyTests-1295386181 None] Create snapshot completed successfully Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b171b7-22a9-407a-86ab-57963b81169b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:05 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 Jun 23 16:10:05 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:05 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.995s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Deleted volume successfully. Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-81ab55ac-4c5a-42e4-a872-32398089ba9b tempest-VolumesSnapshotTestJSON-1519307005 None] Lock "cinder-bffc1af3-e002-45e6-b302-bd4bfc67e030-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:05 devstack sudo[112737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:05 devstack sudo[112737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:06 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" returned: 0 in 1.471s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:06 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d 1G Jun 23 16:10:06 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Flow 'volume_create_manager' (0743b062-5c9e-49a5-809c-4c68f96b5b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79487af-d72b-4cb3-a4c7-d3d370254eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79487af-d72b-4cb3-a4c7-d3d370254eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f078f12-d41d-4499-a7f2-9c6e6abd1d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201c5ee12b7e4f45a7eb1a16bf7dd079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc6f7039-0bae-42e4-89ac-776961d1a76c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:06Z,use_quota=True,user_id='8bc49dcee662451688fbd70eb79e8fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96afec-4b9c-434b-aa5f-cb41d20fab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96afec-4b9c-434b-aa5f-cb41d20fab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66beea6c-0c12-421d-acce-d2448d260c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66beea6c-0c12-421d-acce-d2448d260c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f078f12-d41d-4499-a7f2-9c6e6abd1d6e', 'volume_name': 'volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e', 'volume_size': 1, 'snapshot_id': 'cc6f7039-0bae-42e4-89ac-776961d1a76c'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed106cc-e9f0-4ec2-a20d-d30c99959667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed106cc-e9f0-4ec2-a20d-d30c99959667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081b7125-e8c6-4813-a806-86a6f71491b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:06 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Volume 2f078f12-d41d-4499-a7f2-9c6e6abd1d6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e', 'volume_size': 1, 'snapshot_id': 'cc6f7039-0bae-42e4-89ac-776961d1a76c'} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:06 devstack sudo[112737]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.077s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:10:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:10:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:10:07 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d 1G" returned: 0 in 1.110s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:07 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d Jun 23 16:10:07 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:08 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d" returned: 0 in 0.786s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:08 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d is being set with open permissions: ugo+rw Jun 23 16:10:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:08 devstack sudo[112758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d Jun 23 16:10:08 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:09 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d" returned: 0 in 0.786s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:09 devstack sudo[112762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info Jun 23 16:10:09 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:09 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info" returned: 0 in 0.740s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:09 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info is being set with open permissions: ugo+rw Jun 23 16:10:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:09 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info Jun 23 16:10:09 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:10 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.info" returned: 0 in 0.710s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.725s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Creating volume 2f078f12-d41d-4499-a7f2-9c6e6abd1d6e from snapshot cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:10 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-00530e2e-b6f3-4e21-9ef6-3eca77ba100d tempest-CinderUnicodeTest-830324674 None] Create snapshot completed successfully Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] snapshot: cc6f7039-0bae-42e4-89ac-776961d1a76c, volume: 2f078f12-d41d-4499-a7f2-9c6e6abd1d6e, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a347eff-7a0f-4195-9862-574e9a911cd7]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:10 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:10 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-c659783c-8f84-478f-868e-f03678f9a554-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "cinder-c659783c-8f84-478f-868e-f03678f9a554-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-c115369e-e6e3-4d3d-82c8-fb429f5c390d-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-c115369e-e6e3-4d3d-82c8-fb429f5c390d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-quobyte-c115369e-e6e3-4d3d-82c8-fb429f5c390d" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-c115369e-e6e3-4d3d-82c8-fb429f5c390d" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Deleting offline snapshot c115369e-e6e3-4d3d-82c8-fb429f5c390d of volume 7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] snapshot_file for this snap is: volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c603fd7-525c-4e48-9f9a-b1f4b9fc177a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d546d45-2672-4f5d-806f-880e156c85b7]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:11 devstack sudo[112771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 Jun 23 16:10:11 devstack sudo[112771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:11 devstack sudo[112772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d Jun 23 16:10:11 devstack sudo[112772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:11 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 1.079s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c163e4-4466-4647-883a-da3a71331ee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a8095-a794-4e15-aaee-8d7491cb1c42]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:11 devstack sudo[112779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:10:11 devstack sudo[112779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:12 devstack sudo[112772]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d" returned: 0 in 1.021s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:10:12 devstack sudo[112771]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79c296-d718-4291-93c7-9471e3c909b1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554" returned: 0 in 1.078s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:12 devstack sudo[112790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554 Jun 23 16:10:12 devstack sudo[112790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:12 devstack sudo[112789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 Jun 23 16:10:12 devstack sudo[112789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:12 devstack sudo[112779]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 1.023s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:10:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:12 devstack sudo[112797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e Jun 23 16:10:12 devstack sudo[112797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:13 devstack sudo[112790]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c659783c-8f84-478f-868e-f03678f9a554" returned: 0 in 0.817s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-c659783c-8f84-478f-868e-f03678f9a554" released by "delete_volume" :: held 1.983s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:13 devstack sudo[112789]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Created reservations ['1f21aecd-c98d-4c83-ae6d-8cbcefaeec4b', '835c386e-a71b-4155-8c41-6c0057479206', 'bfe8407f-2695-4a59-9a8f-beb889c810dd', 'eb61b8b2-ca0e-42ae-940b-fdbf3410f352'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" returned: 0 in 0.922s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:13 devstack sudo[112804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d Jun 23 16:10:13 devstack sudo[112804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:13 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:13 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-161f499f-13cf-42cb-a723-fd6ff7505a48-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-161f499f-13cf-42cb-a723-fd6ff7505a48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Deleting offline snapshot 161f499f-13cf-42cb-a723-fd6ff7505a48 of volume 0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] snapshot_file for this snap is: volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[01722403-9200-44f3-b06c-b37f116ee18e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:14 devstack sudo[112811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:10:14 devstack sudo[112811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:14 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:14 devstack sudo[112804]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.454s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:14 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d" returned: 0 in 1.606s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:14 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Deleted volume successfully. Jun 23 16:10:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-62243da5-4d39-4947-a7a9-ae1e882b70a4 tempest-TestStampPattern-1219315605 None] Lock "cinder-c659783c-8f84-478f-868e-f03678f9a554-delete_volume" released by "delete_volume" :: held 3.950s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:14 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d Jun 23 16:10:14 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:16 devstack sudo[112811]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 2.168s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a52b099-76a3-42c4-8843-bf700a651eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d9cf9-59f2-4eb9-8849-8a5dd407865f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:16 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:10:16 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:16 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32.c115369e-e6e3-4d3d-82c8-fb429f5c390d" returned: 0 in 1.518s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-c115369e-e6e3-4d3d-82c8-fb429f5c390d" released by "_delete_snapshot" :: held 5.269s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" released by "delete_snapshot" :: held 5.348s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Created reservations ['c645d599-dacf-41c3-87bc-43a6cead6184', '3ae573a0-2d11-44e7-b744-cd082fa1e0a2', '98e79ed6-aabc-41e4-89ad-53995ee6a0c6', 'be587c62-1087-44a4-b8b8-ae171cb4005c'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Delete snapshot completed successfully. Jun 23 16:10:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91951b46-8b26-4b69-856a-bd64a2681be3 tempest-CinderUnicodeTest-830324674 None] Lock "cinder-c115369e-e6e3-4d3d-82c8-fb429f5c390d-delete_snapshot" released by "delete_snapshot" :: held 5.735s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-7ea765ec-6bd6-4361-b195-71e6ae8d2a32-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "cinder-7ea765ec-6bd6-4361-b195-71e6ae8d2a32-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:18 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[92802a6a-52f7-45cf-9475-a338ba756844]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:18 devstack sudo[112840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 Jun 23 16:10:18 devstack sudo[112840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:18 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 2.720s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:18 devstack sudo[112845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:10:18 devstack sudo[112845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:19 devstack sudo[112797]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" returned: 0 in 6.621s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39d041f-8385-4413-aef5-bf37af3aa6e4]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:19 devstack sudo[112847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:10:19 devstack sudo[112847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:19 devstack sudo[112840]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" returned: 0 in 1.672s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:19 devstack sudo[112853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32 Jun 23 16:10:19 devstack sudo[112853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:20 devstack sudo[112845]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 1.283s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:20 devstack sudo[112858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48 Jun 23 16:10:20 devstack sudo[112858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:20 devstack sudo[112853]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" returned: 0 in 0.751s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-7ea765ec-6bd6-4361-b195-71e6ae8d2a32" released by "delete_volume" :: held 2.596s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Created reservations ['af150589-1e95-4b7a-bac0-f5486703f8be', '45a35029-586b-447d-aa3d-ec4b2b109994', '32b92c10-17eb-4b8d-bbc6-c1b0f9d2956b', '30a5c585-957a-4675-9f34-c19a0db2a212'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:20 devstack sudo[112847]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 1.128s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:10:20 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Converted 1024.00 MB image at 154.64 MB/s Jun 23 16:10:20 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e is being set with open permissions: ugo+rw Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:20 devstack sudo[112864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:20 devstack sudo[112864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:20 devstack sudo[112866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:20 devstack sudo[112866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:20 devstack sudo[112858]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0.161f499f-13cf-42cb-a723-fd6ff7505a48" returned: 0 in 0.835s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-161f499f-13cf-42cb-a723-fd6ff7505a48" released by "_delete_snapshot" :: held 7.165s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" released by "delete_snapshot" :: held 7.194s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Created reservations ['6c404749-c9b7-4102-923f-fd70cccada58', '08656cec-52cf-4dac-ba64-fd8794071706', '4ffac4a9-4cf3-4221-86c2-ddbcbd836b29', '28b1db86-02ce-492c-8e25-e6857b098b04'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Flow 'volume_create_manager' (7848e798-aa40-45cd-b974-d0c926f83662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09cf86a-ee51-42ad-b794-a1923d63e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09cf86a-ee51-42ad-b794-a1923d63e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33e469d-4582-433d-8c0c-f690c15f592b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64dc2bf582f74933b6e658dda366507a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:21Z,use_quota=True,user_id='9aafdc60b3864b0a8fa0f4e284ae505c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d4657-af06-43d9-854a-e4b695b9f19d),volume_type_id=410d4657-af06-43d9-854a-e4b695b9f19d)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bfb44c-bd0e-4f85-b7da-dadb42cf8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bfb44c-bd0e-4f85-b7da-dadb42cf8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d50b771-2e91-48d1-b891-d0c4fd8a7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Delete snapshot completed successfully. Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e43bd4f9-97ff-406f-8d37-9048e2962749 tempest-TestStampPattern-1219315605 None] Lock "cinder-161f499f-13cf-42cb-a723-fd6ff7505a48-delete_snapshot" released by "delete_snapshot" :: held 7.443s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack sudo[112864]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" returned: 0 in 0.774s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" released by "_copy_volume_from_snapshot" :: held 10.765s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" released by "_create_volume_from_snapshot" :: held 10.810s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.849s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-9a706d34-a888-4213-9468-e8f6e1264e03-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "cinder-9a706d34-a888-4213-9468-e8f6e1264e03-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081b7125-e8c6-4813-a806-86a6f71491b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e', 'volume_size': 1, 'snapshot_id': 'cc6f7039-0bae-42e4-89ac-776961d1a76c'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989e5eab-00fb-4a05-be3a-498180692406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Volume volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e (2f078f12-d41d-4499-a7f2-9c6e6abd1d6e): created successfully Jun 23 16:10:21 devstack sudo[112866]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989e5eab-00fb-4a05-be3a-498180692406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Flow 'volume_create_manager' (0743b062-5c9e-49a5-809c-4c68f96b5b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.882s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Deleted volume successfully. Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Acquiring lock "cinder-quobyte-9a706d34-a888-4213-9468-e8f6e1264e03" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d50b771-2e91-48d1-b891-d0c4fd8a7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f33e469d-4582-433d-8c0c-f690c15f592b', 'volume_name': 'volume-f33e469d-4582-433d-8c0c-f690c15f592b', 'volume_size': 1, 'image_id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3046ea98916325e94a4de484a89a3fb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64dc2bf582f74933b6e658dda366507a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3fb94e4c91a2ca25681c3994b7320edf2b1c1d901ab9a850a56f52d1002550f688f6e18ac423328f41001fd84f78c1f9c3377ab5801a87eadba64ac06b47ef9', 'id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'created_at': datetime.datetime(2026, 6, 23, 14, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 10, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28501d67-66bb-444e-81ea-270ad6348a8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984e76ed-b7e3-4124-a41e-eeec98f4f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984e76ed-b7e3-4124-a41e-eeec98f4f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9f57e3-9900-4c4a-bc79-86b6ad657df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Volume f33e469d-4582-433d-8c0c-f690c15f592b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f33e469d-4582-433d-8c0c-f690c15f592b', 'volume_size': 1, 'image_id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3046ea98916325e94a4de484a89a3fb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64dc2bf582f74933b6e658dda366507a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3fb94e4c91a2ca25681c3994b7320edf2b1c1d901ab9a850a56f52d1002550f688f6e18ac423328f41001fd84f78c1f9c3377ab5801a87eadba64ac06b47ef9', 'id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'created_at': datetime.datetime(2026, 6, 23, 14, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 10, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28501d67-66bb-444e-81ea-270ad6348a8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Trying to clone f33e469d-4582-433d-8c0c-f690c15f592b from image 28501d67-66bb-444e-81ea-270ad6348a8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ac6821c9-ac1a-4966-8b7c-4f7ef02f199b tempest-SnapshotDependencyTests-1295386181 None] Created volume successfully. Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-9a706d34-a888-4213-9468-e8f6e1264e03" acquired by "delete_volume" :: waited 0.052s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5310d60-59ef-4fb5-b5bb-6ee1c22ecb9f tempest-CinderUnicodeTest-830324674 None] Lock "cinder-7ea765ec-6bd6-4361-b195-71e6ae8d2a32-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96cdbbc-4ad9-4463-a9d1-f3e2d871fa66]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:10:21 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:10:21 devstack sudo[112871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 Jun 23 16:10:21 devstack sudo[112871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ef092e-ee78-4e13-a5d2-2ced048886c1]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:21 devstack sudo[112874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:21 devstack sudo[112874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-cc6f7039-0bae-42e4-89ac-776961d1a76c-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-cc6f7039-0bae-42e4-89ac-776961d1a76c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Deleting offline snapshot cc6f7039-0bae-42e4-89ac-776961d1a76c of volume 48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] snapshot_file for this snap is: volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795d7ec-db3c-4acf-b85f-1912f7fcb06c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:22 devstack sudo[112881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:22 devstack sudo[112881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:22 devstack sudo[112871]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03" returned: 0 in 1.042s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:22 devstack sudo[112889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03 Jun 23 16:10:22 devstack sudo[112889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:22 devstack sudo[112874]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 0 in 1.179s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:23 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:23 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:23 devstack sudo[112881]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 1.176s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c163e4-4466-4647-883a-da3a71331ee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ce1464-6789-491b-b554-f426d51b3a4c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:23 devstack sudo[112899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:10:23 devstack sudo[112899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:23 devstack sudo[112889]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9a706d34-a888-4213-9468-e8f6e1264e03" returned: 0 in 0.877s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "cinder-quobyte-9a706d34-a888-4213-9468-e8f6e1264e03" released by "delete_volume" :: held 1.992s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Created reservations ['4bae8adb-8176-42f2-b780-6554b42210bc', '2e127dcd-a02f-4add-8471-8153e772309c', 'fc8344cc-0ef2-4abb-8fd0-5b3d4d07a13b', 'a6231021-f168-4b09-9b2f-5bcbdc64e14a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:23 devstack sudo[112904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:23 devstack sudo[112904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:23 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 1 in 0.985s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:23 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Temporary image 28501d67-66bb-444e-81ea-270ad6348a8c is fetched for user 9aafdc60b3864b0a8fa0f4e284ae505c. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:10:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d83cb3-6443-4d81-b50d-01dfe8db8877]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:24 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:24 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:24 devstack sudo[112899]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 1.229s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:24 devstack sudo[112956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:24 devstack sudo[112956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:24 devstack sudo[112904]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.192s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:25 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Deleted volume successfully. Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a5f0b0c0-3f58-4fcf-b328-b861832962af tempest-CinderUnicodeTest-830324674 None] Lock "cinder-9a706d34-a888-4213-9468-e8f6e1264e03-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:25 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 0 in 1.099s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:25 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:25 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:25 devstack sudo[112956]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 1.291s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:26 devstack sudo[112972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c Jun 23 16:10:26 devstack sudo[112972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:26 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 1 in 1.068s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33e469d-4582-433d-8c0c-f690c15f592b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64dc2bf582f74933b6e658dda366507a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:21Z,use_quota=True,user_id='9aafdc60b3864b0a8fa0f4e284ae505c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d4657-af06-43d9-854a-e4b695b9f19d),volume_type_id=410d4657-af06-43d9-854a-e4b695b9f19d)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Creating volume f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:26 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:26 devstack sudo[112978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1073741824 Jun 23 16:10:26 devstack sudo[112978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:26 devstack sudo[112972]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6.cc6f7039-0bae-42e4-89ac-776961d1a76c" returned: 0 in 0.917s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-cc6f7039-0bae-42e4-89ac-776961d1a76c" released by "_delete_snapshot" :: held 4.746s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" released by "delete_snapshot" :: held 4.777s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Created reservations ['c0040f69-b2ac-4347-b464-21523cc2dd19', '661e1468-bc5a-4236-a35e-39d45adcecb7', 'ffccd729-3f8c-4b62-a588-c92254488364', '0f37b9b9-ebee-461d-ae5f-62c3a6172249'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Delete snapshot completed successfully. Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-cd809e80-1cea-4b96-8463-417f66d2809b tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-cc6f7039-0bae-42e4-89ac-776961d1a76c-delete_snapshot" released by "delete_snapshot" :: held 4.939s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:27 devstack sudo[112978]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1073741824" returned: 0 in 1.125s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:27 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:27 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-48c163e4-4466-4647-883a-da3a71331ee6-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-48c163e4-4466-4647-883a-da3a71331ee6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ada1ad-e590-4502-89c3-210ea3d897eb]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:27 devstack sudo[112987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:10:27 devstack sudo[112987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:28 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 0 in 0.728s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Attempting download of 28501d67-66bb-444e-81ea-270ad6348a8c ((None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}])) to volume f33e469d-4582-433d-8c0c-f690c15f592b. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[190c8676-83e8-49f4-ba2b-4a20a4dda5ab]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:28 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx Jun 23 16:10:28 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:28 devstack sudo[112987]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 0.824s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:28 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6 Jun 23 16:10:28 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:29 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx" returned: 0 in 0.765s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:29 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx Jun 23 16:10:29 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:29 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-48c163e4-4466-4647-883a-da3a71331ee6" returned: 0 in 0.722s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-48c163e4-4466-4647-883a-da3a71331ee6" released by "delete_volume" :: held 1.641s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Created reservations ['7d1f5e51-b669-4042-a68d-d33e2861d589', '77e6d77f-2c90-46cd-b917-b6b5f618a36f', 'f5035931-2725-43c9-85ec-dc1318222aaf', '23b34114-321d-4e14-ac57-707d192ccb3e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:29 devstack sudo[113002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:29 devstack sudo[113002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:29 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx" returned: 1 in 0.845s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_28501d67-66bb-444e-81ea-270ad6348a8c_ry9ygwmx' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0941774-0158-435e-a71a-4de221a319ed]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ef4ae-15aa-4d44-a84d-74dee845ca5c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:30 devstack sudo[113006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:30 devstack sudo[113006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-0a52b099-76a3-42c4-8843-bf700a651eb0-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "cinder-0a52b099-76a3-42c4-8843-bf700a651eb0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:30 devstack sudo[113007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e Jun 23 16:10:30 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Acquiring lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:30 devstack sudo[113002]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.804s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:30 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Deleted volume successfully. Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d2b32-cbf4-4e4f-b1bc-32ca9e9b2e8f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-987ec9d9-d647-4717-b048-78cf70118858 tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-48c163e4-4466-4647-883a-da3a71331ee6-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:30 devstack sudo[113011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:10:30 devstack sudo[113011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:30 devstack sudo[113006]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:30 devstack sudo[113017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD Jun 23 16:10:30 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:31 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" returned: 0 in 1.040s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:31 devstack sudo[113020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e Jun 23 16:10:31 devstack sudo[113020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:31 devstack sudo[113011]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 0.924s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:31 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0 Jun 23 16:10:31 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:31 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD" returned: 1 in 0.786s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] 28501d67-66bb-444e-81ea-270ad6348a8c was raw, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:31 devstack sudo[113031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:31 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:31 devstack sudo[113020]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" returned: 0 in 0.724s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-quobyte-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e" released by "delete_volume" :: held 1.834s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Created reservations ['15eb0d91-8baa-47bf-8bf1-505e63fed44a', '6f21c474-1b77-4e90-a94f-a9db95434b2a', 'ab5b5776-cb1c-46e6-8742-47285b72e76d', 'a5944a7b-3aac-48c5-a0a2-27d9898210f2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:32 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:32 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:32 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-0a52b099-76a3-42c4-8843-bf700a651eb0" returned: 0 in 0.871s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "cinder-quobyte-0a52b099-76a3-42c4-8843-bf700a651eb0" released by "delete_volume" :: held 1.882s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Created reservations ['0db2f7b4-06c2-486c-b7c7-bbd8422667dd', 'df873dcb-dc2e-49bb-9b4f-712696cbad80', '977617b1-489e-4364-82b8-f497999d06ba', '62f294e3-3882-4c13-a87c-8e6aabb8992b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:32 devstack sudo[113038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:32 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:32 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 0 in 1.087s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_28501d67-66bb-444e-81ea-270ad6348a8c_7z8zsneodevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:10:32 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:10:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:32 devstack sudo[113042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1G Jun 23 16:10:32 devstack sudo[113042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:33 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.161s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Deleted volume successfully. Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-91f5f156-48e1-4be0-9b1c-1b71e7390e0f tempest-SnapshotDependencyTests-1295386181 None] Lock "cinder-2f078f12-d41d-4499-a7f2-9c6e6abd1d6e-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:33 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.309s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Deleted volume successfully. Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3344ddb2-bf31-484b-98de-13c47ba84103 tempest-TestStampPattern-1219315605 None] Lock "cinder-0a52b099-76a3-42c4-8843-bf700a651eb0-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:33 devstack sudo[113042]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b 1G" returned: 0 in 1.105s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[775c4e13-fd26-4ffe-aea2-2571cd5cb9d4]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:34 devstack sudo[113048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:34 devstack sudo[113048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:34 devstack sudo[113048]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:35 devstack sudo[113054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:35 devstack sudo[113054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:35 devstack sudo[113054]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 1 in 0.871s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Downloaded image 28501d67-66bb-444e-81ea-270ad6348a8c ((None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}])) to volume f33e469d-4582-433d-8c0c-f690c15f592b successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Temporary image 28501d67-66bb-444e-81ea-270ad6348a8c for user 9aafdc60b3864b0a8fa0f4e284ae505c is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Marking volume f33e469d-4582-433d-8c0c-f690c15f592b as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Copying metadata from image 28501d67-66bb-444e-81ea-270ad6348a8c to f33e469d-4582-433d-8c0c-f690c15f592b. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Creating volume glance metadata for volume f33e469d-4582-433d-8c0c-f690c15f592b backed by image 28501d67-66bb-444e-81ea-270ad6348a8c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3046ea98916325e94a4de484a89a3fb6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9f57e3-9900-4c4a-bc79-86b6ad657df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33e469d-4582-433d-8c0c-f690c15f592b', 'volume_size': 1, 'image_id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/28501d67-66bb-444e-81ea-270ad6348a8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3046ea98916325e94a4de484a89a3fb6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64dc2bf582f74933b6e658dda366507a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3fb94e4c91a2ca25681c3994b7320edf2b1c1d901ab9a850a56f52d1002550f688f6e18ac423328f41001fd84f78c1f9c3377ab5801a87eadba64ac06b47ef9', 'id': '28501d67-66bb-444e-81ea-270ad6348a8c', 'created_at': datetime.datetime(2026, 6, 23, 14, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 10, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/28501d67-66bb-444e-81ea-270ad6348a8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8908cc46-1b2e-4cae-8d6e-fae1659ff945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:35 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Volume volume-f33e469d-4582-433d-8c0c-f690c15f592b (f33e469d-4582-433d-8c0c-f690c15f592b): created successfully Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8908cc46-1b2e-4cae-8d6e-fae1659ff945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:35 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Flow 'volume_create_manager' (7848e798-aa40-45cd-b974-d0c926f83662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:35 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6c9aa861-3734-41a2-b06e-0787ce2cec16 tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Created volume successfully. Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Acquiring lock "cinder-f33e469d-4582-433d-8c0c-f690c15f592b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "cinder-f33e469d-4582-433d-8c0c-f690c15f592b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Acquiring lock "cinder-quobyte-f33e469d-4582-433d-8c0c-f690c15f592b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "cinder-quobyte-f33e469d-4582-433d-8c0c-f690c15f592b" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c153a9-ed12-4326-b6d6-2ee7036d7872]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:36 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:36 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:37 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 0 in 1.130s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:38 devstack sudo[113065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:38 devstack sudo[113065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:38 devstack sudo[113065]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 1 in 0.983s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:10:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:38 devstack sudo[113071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b Jun 23 16:10:38 devstack sudo[113071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:39 devstack sudo[113071]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f33e469d-4582-433d-8c0c-f690c15f592b" returned: 0 in 0.847s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "cinder-quobyte-f33e469d-4582-433d-8c0c-f690c15f592b" released by "delete_volume" :: held 3.048s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=118,cinder:INSERT=34,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=107,cinder:UPDATE=138,cinder:INSERT=43,cinder:DELETE=12 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:10:39 devstack cinder-volume[93590]: WARNING cinder.quota [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:10:39 devstack cinder-volume[93590]: WARNING cinder.quota [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Created reservations ['2948825c-781e-4ab9-aaf9-7341bcc75785', '4b931b25-1ee8-4c4d-b80a-f13d2b230664', '074f4689-c23e-410f-a6dc-f535b9fd7be5', '9a555c71-da2f-4e89-bfae-c964998ad02a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:39 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:40 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:10:40 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:40 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.833s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:10:40 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Deleted volume successfully. Jun 23 16:10:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-28e025df-43c9-42d2-8773-6d0519453cac tempest-VolumeAndVolumeTypeFromImageTest-458876567 None] Lock "cinder-f33e469d-4582-433d-8c0c-f690c15f592b-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (f7e3216d-acce-4919-a330-ebab83649309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d89a7-03dc-4728-b786-2721bddd1cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d89a7-03dc-4728-b786-2721bddd1cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252763179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2276ecb7-3680-4b6f-855c-59de18e31eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:47Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4ea231-c96c-45ee-b2f7-f79f1e4e91b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4ea231-c96c-45ee-b2f7-f79f1e4e91b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2572918-8f9e-449c-b4ec-1f291000c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2572918-8f9e-449c-b4ec-1f291000c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2276ecb7-3680-4b6f-855c-59de18e31eb4', 'volume_name': 'volume-2276ecb7-3680-4b6f-855c-59de18e31eb4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a04095-2e91-4d21-96b9-c16785f46eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a04095-2e91-4d21-96b9-c16785f46eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd77b220-3975-4303-b199-1be7edc78b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:46 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume 2276ecb7-3680-4b6f-855c-59de18e31eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2276ecb7-3680-4b6f-855c-59de18e31eb4', 'volume_size': 1} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252763179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2276ecb7-3680-4b6f-855c-59de18e31eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:47Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume 2276ecb7-3680-4b6f-855c-59de18e31eb4 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:46 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:46 devstack sudo[113085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 1073741824 Jun 23 16:10:46 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:47 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 1073741824" returned: 0 in 0.941s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:47 devstack sudo[113090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 Jun 23 16:10:47 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (76a77f43-b9ec-4985-af55-c31570b9e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc22171a-7210-4983-84fa-a63d6273353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc22171a-7210-4983-84fa-a63d6273353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868566993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b740e5a2-782d-49d4-8b14-de9eb79ac64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:48Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84458c70-0852-496e-b02b-5e38775ec37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84458c70-0852-496e-b02b-5e38775ec37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb993816-27b0-42eb-aff0-5c9a8219e2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb993816-27b0-42eb-aff0-5c9a8219e2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b740e5a2-782d-49d4-8b14-de9eb79ac64e', 'volume_name': 'volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc5938c-b45d-4341-bf25-e2aac4117ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc5938c-b45d-4341-bf25-e2aac4117ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f5a7e-bc1a-4a36-87f4-b8df51947393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:47 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Volume b740e5a2-782d-49d4-8b14-de9eb79ac64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e', 'volume_size': 1} Jun 23 16:10:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (8ae3c703-936f-4135-a067-0fa0ad61bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2cd17-5a4c-4f74-afe2-141a5b71cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2cd17-5a4c-4f74-afe2-141a5b71cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452517438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915c5eba-a483-423a-8a06-62bc49195e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:48Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5890264-4392-48bb-a477-369ac910d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5890264-4392-48bb-a477-369ac910d50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0b635e-9eab-49e2-9188-ea01114aa612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0b635e-9eab-49e2-9188-ea01114aa612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915c5eba-a483-423a-8a06-62bc49195e09', 'volume_name': 'volume-915c5eba-a483-423a-8a06-62bc49195e09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a3e3e-c7be-4d33-a7e0-48554b32913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576a3e3e-c7be-4d33-a7e0-48554b32913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6240bd-3044-4ca4-a2ea-62c828a99655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Volume 915c5eba-a483-423a-8a06-62bc49195e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915c5eba-a483-423a-8a06-62bc49195e09', 'volume_size': 1} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:48 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4" returned: 0 in 0.794s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868566993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b740e5a2-782d-49d4-8b14-de9eb79ac64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:48Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Creating volume b740e5a2-782d-49d4-8b14-de9eb79ac64e {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:48 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:48 devstack sudo[113093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e 1073741824 Jun 23 16:10:48 devstack sudo[113093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd77b220-3975-4303-b199-1be7edc78b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2276ecb7-3680-4b6f-855c-59de18e31eb4', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc351140-b495-4c20-893a-68f9ef3ce94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 (2276ecb7-3680-4b6f-855c-59de18e31eb4): created successfully Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc351140-b495-4c20-893a-68f9ef3ce94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (f7e3216d-acce-4919-a330-ebab83649309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (2f7fc81a-926f-4510-a4f5-4e637865d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e6f36b-642f-4587-a5f4-e30759017888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e6f36b-642f-4587-a5f4-e30759017888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580024000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0317105-576d-4a17-b7d5-6ecd735c334b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48f3c76-f4e8-4002-8cb3-e13c8580ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48f3c76-f4e8-4002-8cb3-e13c8580ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac66137-8196-4ac3-a482-9fa4bf314fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac66137-8196-4ac3-a482-9fa4bf314fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0317105-576d-4a17-b7d5-6ecd735c334b', 'volume_name': 'volume-f0317105-576d-4a17-b7d5-6ecd735c334b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65c0769-8143-48a5-b638-1aead95467a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65c0769-8143-48a5-b638-1aead95467a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db97ea-f2ae-46c2-8da5-9f3a4f25b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:48 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Volume f0317105-576d-4a17-b7d5-6ecd735c334b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0317105-576d-4a17-b7d5-6ecd735c334b', 'volume_size': 1} Jun 23 16:10:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:48 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-834d2455-b900-4679-83a4-022592ab50a4 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (0737ec14-c719-4165-b7a6-1a39e25702ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd422d2-d75c-40be-ae02-f5107a034254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd422d2-d75c-40be-ae02-f5107a034254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123148020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb79d91b-28ce-4d9d-acff-d0102182264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb79d91b-28ce-4d9d-acff-d0102182264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef80a93-3bf5-4d7f-95ae-f6e516a39cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef80a93-3bf5-4d7f-95ae-f6e516a39cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b', 'volume_name': 'volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d3eb2e-6ce5-4f0c-9756-2775a6a27911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d3eb2e-6ce5-4f0c-9756-2775a6a27911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdef9d47-a3cd-4cce-824a-1973b42387d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Volume f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b', 'volume_size': 1} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:49 devstack sudo[113093]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e 1073741824" returned: 0 in 1.104s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:49 devstack sudo[113100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e Jun 23 16:10:49 devstack sudo[113100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (5a122f1f-876f-4df4-9656-0d3b201ba3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4da83a-e43c-469d-852c-ae1dd6e6ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4da83a-e43c-469d-852c-ae1dd6e6ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597572357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2378b9-9ef5-43bf-bcd3-01645904ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f72535-c216-4513-b00e-75d32a478fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f72535-c216-4513-b00e-75d32a478fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5c6737-d968-4330-81c5-f7609db1cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5c6737-d968-4330-81c5-f7609db1cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2378b9-9ef5-43bf-bcd3-01645904ad0a', 'volume_name': 'volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df5d45d-f846-4abc-9662-5fc30054c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df5d45d-f846-4abc-9662-5fc30054c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa19c6d5-adc3-4b92-b0c3-8abb4ada3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume 3b2378b9-9ef5-43bf-bcd3-01645904ad0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a', 'volume_size': 1} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (5ccaa82b-1999-464e-93b5-97d5dcd8b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8452d6bb-9e16-4c28-bb5c-1e420866ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8452d6bb-9e16-4c28-bb5c-1e420866ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470254637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a445c688-7385-4a81-96af-6c33837127e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2d261c-8922-44a1-b2c6-8c23d41d185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2d261c-8922-44a1-b2c6-8c23d41d185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b774b-12b3-4a96-aecd-47ef73791879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b774b-12b3-4a96-aecd-47ef73791879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a445c688-7385-4a81-96af-6c33837127e8', 'volume_name': 'volume-a445c688-7385-4a81-96af-6c33837127e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3754f7f7-4e69-414b-98d3-9593b07e91ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3754f7f7-4e69-414b-98d3-9593b07e91ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ef1db-4d3a-4643-aec2-aea8074a788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Volume a445c688-7385-4a81-96af-6c33837127e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a445c688-7385-4a81-96af-6c33837127e8', 'volume_size': 1} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (a5fa60f7-b005-4b6b-b9ab-1c4738a0c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648bed5c-d7cd-42cb-8109-5247d89feb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648bed5c-d7cd-42cb-8109-5247d89feb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750741803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d82fac-41ca-45c1-848d-52fb4d779271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8061d53-2359-4778-bfa9-d360e5764feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8061d53-2359-4778-bfa9-d360e5764feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c6dc57-092d-4df7-8ec6-526b96afc59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c6dc57-092d-4df7-8ec6-526b96afc59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d82fac-41ca-45c1-848d-52fb4d779271', 'volume_name': 'volume-18d82fac-41ca-45c1-848d-52fb4d779271', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d4ad2-08c8-4e97-853f-e76adfd203d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d4ad2-08c8-4e97-853f-e76adfd203d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02771b3f-cb45-4d92-80a1-fe3eaa41d4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume 18d82fac-41ca-45c1-848d-52fb4d779271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d82fac-41ca-45c1-848d-52fb4d779271', 'volume_size': 1} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (db969f6e-9960-4cff-8586-0a1ff5f37b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d04947c-02e8-401f-b990-3b3134e59a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d04947c-02e8-401f-b990-3b3134e59a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358394915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46294c23-8114-47a5-92a1-89a88d53db2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c81c8-a09a-4d80-8246-73d1fe160d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6c81c8-a09a-4d80-8246-73d1fe160d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad099a1-fd96-44b5-84c8-ba3c0cdd228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad099a1-fd96-44b5-84c8-ba3c0cdd228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46294c23-8114-47a5-92a1-89a88d53db2a', 'volume_name': 'volume-46294c23-8114-47a5-92a1-89a88d53db2a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425fe819-d4ea-49ff-aad4-331c5c5ee289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425fe819-d4ea-49ff-aad4-331c5c5ee289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bec8e33-31a8-47a7-9e61-eeab1425303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume 46294c23-8114-47a5-92a1-89a88d53db2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46294c23-8114-47a5-92a1-89a88d53db2a', 'volume_size': 1} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:50 devstack sudo[113100]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e" returned: 0 in 0.824s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452517438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915c5eba-a483-423a-8a06-62bc49195e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:48Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Creating volume 915c5eba-a483-423a-8a06-62bc49195e09 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:50 devstack sudo[113103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 1073741824 Jun 23 16:10:50 devstack sudo[113103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f5a7e-bc1a-4a36-87f4-b8df51947393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edfebfb-3a21-48f8-9011-1eea7989165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Volume volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e (b740e5a2-782d-49d4-8b14-de9eb79ac64e): created successfully Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edfebfb-3a21-48f8-9011-1eea7989165a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (76a77f43-b9ec-4985-af55-c31570b9e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-37199a42-4cfd-4701-8afb-ade61a6cdf9f tempest-CreateVolumesFromImageTest-413827844 None] Created volume successfully. Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (577400ba-54e3-4eb8-b797-5dd113ffe7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62159a4-5221-4a77-8df1-bd0d9eb9d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62159a4-5221-4a77-8df1-bd0d9eb9d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1328805862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee90bb83-6383-4612-90cb-4b82a4e1af63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:51Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9f9a42-d0d7-4a72-bcdb-cc9d8183a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9f9a42-d0d7-4a72-bcdb-cc9d8183a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84382114-d6fb-4222-9173-f43fb7e9ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84382114-d6fb-4222-9173-f43fb7e9ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee90bb83-6383-4612-90cb-4b82a4e1af63', 'volume_name': 'volume-ee90bb83-6383-4612-90cb-4b82a4e1af63', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91ad90e-f55f-405d-af04-6b66ed311f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91ad90e-f55f-405d-af04-6b66ed311f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8284c13c-8ca4-48db-8060-4305813d90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume ee90bb83-6383-4612-90cb-4b82a4e1af63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee90bb83-6383-4612-90cb-4b82a4e1af63', 'volume_size': 1} Jun 23 16:10:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (a4deae99-1536-4b4d-9cf5-0bf4eba0f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73387c11-2e8a-4001-a120-9928eaac4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73387c11-2e8a-4001-a120-9928eaac4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595286468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:51Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e21f81-7dfc-4efd-b640-694f23084b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e21f81-7dfc-4efd-b640-694f23084b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780f95db-8ee3-47c1-bb3a-d3fe8740445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780f95db-8ee3-47c1-bb3a-d3fe8740445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b', 'volume_name': 'volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac0da5-dc80-48a3-bbe5-dc96d75086d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac0da5-dc80-48a3-bbe5-dc96d75086d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b02e00a-b8dd-4366-975b-0955d87d7b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:51 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b', 'volume_size': 1} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:51 devstack sudo[113103]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 1073741824" returned: 0 in 0.883s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:51 devstack sudo[113109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 Jun 23 16:10:51 devstack sudo[113109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:52 devstack sudo[113109]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09" returned: 0 in 0.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.437s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580024000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0317105-576d-4a17-b7d5-6ecd735c334b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Creating volume f0317105-576d-4a17-b7d5-6ecd735c334b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:52 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:52 devstack sudo[113112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b 1073741824 Jun 23 16:10:52 devstack sudo[113112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6240bd-3044-4ca4-a2ea-62c828a99655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915c5eba-a483-423a-8a06-62bc49195e09', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c7df2-d08e-4cd2-b956-e7f2b20a4440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Volume volume-915c5eba-a483-423a-8a06-62bc49195e09 (915c5eba-a483-423a-8a06-62bc49195e09): created successfully Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686c7df2-d08e-4cd2-b956-e7f2b20a4440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (8ae3c703-936f-4135-a067-0fa0ad61bff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:52 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-faf7ade9-f8ca-47c7-b217-85fc4cb63d6c tempest-CreateVolumesFromImageTest-413827844 None] Created volume successfully. Jun 23 16:10:52 devstack sudo[113112]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b 1073741824" returned: 0 in 0.806s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:52 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b Jun 23 16:10:52 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:53 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b" returned: 0 in 0.641s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123148020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Creating volume f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:53 devstack sudo[113156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b 1073741824 Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1db97ea-f2ae-46c2-8da5-9f3a4f25b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0317105-576d-4a17-b7d5-6ecd735c334b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:53 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e84e45-1629-49da-99af-815ea543aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Volume volume-f0317105-576d-4a17-b7d5-6ecd735c334b (f0317105-576d-4a17-b7d5-6ecd735c334b): created successfully Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e84e45-1629-49da-99af-815ea543aaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (2f7fc81a-926f-4510-a4f5-4e637865d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-af0b372c-2f28-47be-8bf4-45f2fb135bef tempest-CreateVolumesFromImageTest-413827844 None] Created volume successfully. Jun 23 16:10:54 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b 1073741824" returned: 0 in 0.898s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:54 devstack sudo[113161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b Jun 23 16:10:54 devstack sudo[113161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:55 devstack sudo[113161]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" returned: 0 in 0.645s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.337s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597572357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2378b9-9ef5-43bf-bcd3-01645904ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:49Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume 3b2378b9-9ef5-43bf-bcd3-01645904ad0a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:55 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdef9d47-a3cd-4cce-824a-1973b42387d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:55 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a 1073741824 Jun 23 16:10:55 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73578f9-ce17-4cef-a8f8-5c472f03f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Volume volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b (f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b): created successfully Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73578f9-ce17-4cef-a8f8-5c472f03f633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (0737ec14-c719-4165-b7a6-1a39e25702ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-00e5e1bc-7947-42d4-899d-aea736773ff7 tempest-CreateVolumesFromImageTest-413827844 None] Created volume successfully. Jun 23 16:10:56 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a 1073741824" returned: 0 in 0.851s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:56 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a Jun 23 16:10:56 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:56 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" returned: 0 in 0.651s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.693s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-470254637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a445c688-7385-4a81-96af-6c33837127e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92841d1d5546f6a93a11d02e9ca30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='c14e8de7f3d440d7b7d0ff6acf2eef69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Creating volume a445c688-7385-4a81-96af-6c33837127e8 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:56 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa19c6d5-adc3-4b92-b0c3-8abb4ada3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:56 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 1073741824 Jun 23 16:10:56 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5fe5ce-40e6-457e-becb-9472feeac215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a (3b2378b9-9ef5-43bf-bcd3-01645904ad0a): created successfully Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5fe5ce-40e6-457e-becb-9472feeac215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (5a122f1f-876f-4df4-9656-0d3b201ba3f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a580dca7-70c0-42dd-bc3d-44b9e72b6715 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:10:57 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 1073741824" returned: 0 in 0.856s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:57 devstack sudo[113179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 Jun 23 16:10:57 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:58 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8" returned: 0 in 0.658s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.103s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1750741803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d82fac-41ca-45c1-848d-52fb4d779271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume 18d82fac-41ca-45c1-848d-52fb4d779271 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:10:58 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ef1db-4d3a-4643-aec2-aea8074a788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a445c688-7385-4a81-96af-6c33837127e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:58 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 1073741824 Jun 23 16:10:58 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1766c7ee-3200-4d4b-ae29-fb8d693797f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:10:58 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Volume volume-a445c688-7385-4a81-96af-6c33837127e8 (a445c688-7385-4a81-96af-6c33837127e8): created successfully Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1766c7ee-3200-4d4b-ae29-fb8d693797f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:10:58 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Flow 'volume_create_manager' (5ccaa82b-1999-464e-93b5-97d5dcd8b05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:10:58 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ae5aaa7f-a9c0-4d35-8f0b-8539cd4ee794 tempest-CreateVolumesFromImageTest-413827844 None] Created volume successfully. Jun 23 16:10:59 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 1073741824" returned: 0 in 0.876s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:59 devstack sudo[113187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 Jun 23 16:10:59 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-a445c688-7385-4a81-96af-6c33837127e8-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-a445c688-7385-4a81-96af-6c33837127e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-quobyte-a445c688-7385-4a81-96af-6c33837127e8" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-a445c688-7385-4a81-96af-6c33837127e8" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cb9e7-1677-4947-accb-dddbf7772364]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:10:59 devstack sudo[113189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 Jun 23 16:10:59 devstack sudo[113189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:10:59 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root Jun 23 16:10:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271" returned: 0 in 0.767s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.571s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358394915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46294c23-8114-47a5-92a1-89a88d53db2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:50Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume 46294c23-8114-47a5-92a1-89a88d53db2a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:00 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02771b3f-cb45-4d92-80a1-fe3eaa41d4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d82fac-41ca-45c1-848d-52fb4d779271', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:00 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a 1073741824 Jun 23 16:11:00 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1a5cd2-2a85-4634-b494-13f0ca6bfea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-18d82fac-41ca-45c1-848d-52fb4d779271 (18d82fac-41ca-45c1-848d-52fb4d779271): created successfully Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1a5cd2-2a85-4634-b494-13f0ca6bfea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (a5fa60f7-b005-4b6b-b9ab-1c4738a0c50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-45a4c1ce-565a-49a8-ac10-47915dbb18e9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:11:00 devstack sudo[113189]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8" returned: 0 in 0.845s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:00 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8 Jun 23 16:11:00 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:01 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a445c688-7385-4a81-96af-6c33837127e8" returned: 0 in 0.755s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:01 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-a445c688-7385-4a81-96af-6c33837127e8" released by "delete_volume" :: held 1.659s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a 1073741824" returned: 0 in 1.054s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:01 devstack sudo[113204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a Jun 23 16:11:01 devstack sudo[113204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Created reservations ['3fb2d32d-8c40-45bf-b15a-ec1f320144f2', '50425571-7a65-4e21-8dd8-723eeb9445cd', 'db347aaf-950f-4b2d-962b-62ee63f36e4c', 'e591dc2c-0cba-4525-90b4-8b8fc9681879'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:01 devstack sudo[113206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:01 devstack sudo[113206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-quobyte-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e65656-a799-4460-98ca-eda21d876323]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:01 devstack sudo[113210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b Jun 23 16:11:01 devstack sudo[113210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:01 devstack sudo[113204]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a" returned: 0 in 0.815s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.053s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1328805862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee90bb83-6383-4612-90cb-4b82a4e1af63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:51Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume ee90bb83-6383-4612-90cb-4b82a4e1af63 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:01 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:01 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 1073741824 Jun 23 16:11:01 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:01 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bec8e33-31a8-47a7-9e61-eeab1425303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46294c23-8114-47a5-92a1-89a88d53db2a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515c931-08b9-4917-af44-022bdfa4c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-46294c23-8114-47a5-92a1-89a88d53db2a (46294c23-8114-47a5-92a1-89a88d53db2a): created successfully Jun 23 16:11:02 devstack sudo[113206]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515c931-08b9-4917-af44-022bdfa4c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (db969f6e-9960-4cff-8586-0a1ff5f37b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.797s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Deleted volume successfully. Jun 23 16:11:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a834f1b7-9717-4680-8f80-9c9d101f1dda tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6fb2789b-45d5-4165-8eec-cc8400f1fabb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-a445c688-7385-4a81-96af-6c33837127e8-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:02 devstack sudo[113210]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" returned: 0 in 0.847s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:02 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b Jun 23 16:11:02 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:02 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 1073741824" returned: 0 in 0.991s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:03 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 Jun 23 16:11:03 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:03 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" returned: 0 in 0.662s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b" released by "delete_volume" :: held 1.572s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Created reservations ['0f344141-cd49-44c7-a7b0-9c13d11a1363', '269cbacf-f0a8-4e1f-979a-b88ca438ee71', 'b7358dc0-35bd-4742-82d9-d23a0ddf94b1', '546182b1-166b-4942-a6f1-b8e8eef57e4b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:03 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:03 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:03 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63" returned: 0 in 0.661s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.442s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595286468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0a8dde1e7e47d598244b5aa1fff706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:10:51Z,use_quota=True,user_id='3be52d87202d44cebcdf57fa28ea30c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Creating volume b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:03 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8284c13c-8ca4-48db-8060-4305813d90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee90bb83-6383-4612-90cb-4b82a4e1af63', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff472401-e90b-49ba-9437-e8a2b7b0aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:03 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b 1073741824 Jun 23 16:11:03 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:03 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 (ee90bb83-6383-4612-90cb-4b82a4e1af63): created successfully Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff472401-e90b-49ba-9437-e8a2b7b0aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (577400ba-54e3-4eb8-b797-5dd113ffe7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:03 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d4569871-645f-4697-8894-9cfcba5f0f48 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-f0317105-576d-4a17-b7d5-6ecd735c334b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-f0317105-576d-4a17-b7d5-6ecd735c334b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-quobyte-f0317105-576d-4a17-b7d5-6ecd735c334b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-f0317105-576d-4a17-b7d5-6ecd735c334b" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abaf560-5bc4-4f56-9f93-ff8a3cfd030e]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:04 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b Jun 23 16:11:04 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:04 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.782s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Deleted volume successfully. Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-58cac761-e3df-4348-9514-eb10dbd389e4 tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-f0997ef8-4b0e-4d87-98ca-bb8789ed7f1b-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:04 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b 1073741824" returned: 0 in 0.875s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:04 devstack sudo[113239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b Jun 23 16:11:04 devstack sudo[113239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:04 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b" returned: 0 in 0.833s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:04 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b Jun 23 16:11:04 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:05 devstack sudo[113239]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" returned: 0 in 0.650s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b02e00a-b8dd-4366-975b-0955d87d7b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c8369-be3c-49c9-a392-c35d443ca51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:05 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Volume volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b (b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b): created successfully Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2c8369-be3c-49c9-a392-c35d443ca51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Flow 'volume_create_manager' (a4deae99-1536-4b4d-9cf5-0bf4eba0f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:05 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ef7e872b-c3e9-4eab-9523-3bedd0897ac9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created volume successfully. Jun 23 16:11:05 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-f0317105-576d-4a17-b7d5-6ecd735c334b" returned: 0 in 0.649s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-f0317105-576d-4a17-b7d5-6ecd735c334b" released by "delete_volume" :: held 1.542s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Created reservations ['48d53901-e980-4445-a685-8dcb809aa3e8', 'de727c62-6e64-43e1-b849-14a4058d0f06', 'e3e4f897-1163-4377-8caf-081bcdec50ff', '782ab0db-813e-42c4-882a-593b84608f11'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:05 devstack sudo[113249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:05 devstack sudo[113249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:05 devstack sudo[113251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:05 devstack sudo[113251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-915c5eba-a483-423a-8a06-62bc49195e09-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-915c5eba-a483-423a-8a06-62bc49195e09-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-quobyte-915c5eba-a483-423a-8a06-62bc49195e09" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-915c5eba-a483-423a-8a06-62bc49195e09" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cded65f-404e-441b-a137-d2cc2026b37f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:06 devstack sudo[113254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 Jun 23 16:11:06 devstack sudo[113254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:06 devstack sudo[113249]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.849s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Deleted volume successfully. Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9c05e490-afd8-453d-b594-53cf022158eb tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-f0317105-576d-4a17-b7d5-6ecd735c334b-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[24531b72-deb3-4b77-8ad1-9c7c41d0f7c1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:06 devstack sudo[113251]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.764s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 28 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:11:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:11:06 devstack sudo[113257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b Jun 23 16:11:06 devstack sudo[113257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:07 devstack sudo[113254]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09" returned: 0 in 0.944s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:07 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09 Jun 23 16:11:07 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:07 devstack sudo[113257]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" returned: 0 in 0.821s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:07 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b Jun 23 16:11:07 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:07 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-915c5eba-a483-423a-8a06-62bc49195e09" returned: 0 in 0.704s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-915c5eba-a483-423a-8a06-62bc49195e09" released by "delete_volume" :: held 1.712s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Created reservations ['79a52409-a160-4150-9f29-07835f036b1b', 'e2c83b17-570b-4270-a8bb-7e89c2be0945', '4bacb6e6-9423-4905-b01b-fc957c918180', '66937b37-9f3b-4064-b047-9953db5dab00'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:08 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" returned: 0 in 0.711s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:08 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:08 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b" released by "delete_volume" :: held 1.595s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['d75bf8f0-259c-4134-820b-174e3bed8977', '8a2242f9-fb52-43f0-ac48-663f63265ace', '4f8887cb-d8ac-4ead-add2-5dee1128a654', '061bda0e-6d26-4dd2-bcd6-703a1a004735'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:08 devstack sudo[113273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:08 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-b740e5a2-782d-49d4-8b14-de9eb79ac64e-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-b740e5a2-782d-49d4-8b14-de9eb79ac64e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "cinder-quobyte-b740e5a2-782d-49d4-8b14-de9eb79ac64e" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-b740e5a2-782d-49d4-8b14-de9eb79ac64e" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63d26c8-9343-4143-98ad-d57adc649f61]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-ee90bb83-6383-4612-90cb-4b82a4e1af63-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-ee90bb83-6383-4612-90cb-4b82a4e1af63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:08 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e Jun 23 16:11:08 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-ee90bb83-6383-4612-90cb-4b82a4e1af63" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-ee90bb83-6383-4612-90cb-4b82a4e1af63" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c9602-3d10-4ff2-a103-544d731c5e5f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:08 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.816s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:08 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Deleted volume successfully. Jun 23 16:11:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fe0eb800-edcc-44e3-827b-e0350ec4750d tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-915c5eba-a483-423a-8a06-62bc49195e09-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:08 devstack sudo[113278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 Jun 23 16:11:08 devstack sudo[113278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:09 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.826s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ca3917c3-f162-4309-bd39-6f0a68152e4f tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-b3435ba4-d63a-4ac8-a114-0cd6fd5f5b6b-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:09 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e" returned: 0 in 0.943s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:09 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e Jun 23 16:11:09 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:09 devstack sudo[113278]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63" returned: 0 in 0.845s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:09 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63 Jun 23 16:11:09 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:10 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b740e5a2-782d-49d4-8b14-de9eb79ac64e" returned: 0 in 0.689s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-quobyte-b740e5a2-782d-49d4-8b14-de9eb79ac64e" released by "delete_volume" :: held 1.683s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Created reservations ['be521343-17e9-4c8c-bd27-6d51594011d7', 'c170d263-bb97-4c75-9d64-180bfa58bae7', '556b0851-a77a-43fb-9441-0f7f1ba40e68', '13d01355-2f6e-485c-830f-322562fa2b79'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:10 devstack sudo[113294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:10 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:10 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ee90bb83-6383-4612-90cb-4b82a4e1af63" returned: 0 in 0.696s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-ee90bb83-6383-4612-90cb-4b82a4e1af63" released by "delete_volume" :: held 1.596s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['4ad35744-8783-4bad-af3e-98fb32f9ebae', '2165ef9f-ab58-43d2-bc14-6fa66b25d56e', '4f486ed1-e7f3-4d5b-b3de-c1fa3ece3a9c', 'c4bc2002-aaf1-4073-8174-9ee461115148'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:10 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:10 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-46294c23-8114-47a5-92a1-89a88d53db2a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-46294c23-8114-47a5-92a1-89a88d53db2a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-46294c23-8114-47a5-92a1-89a88d53db2a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-46294c23-8114-47a5-92a1-89a88d53db2a" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:11 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.806s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Deleted volume successfully. Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e53f41-5099-4492-a40f-3daa4536f4a3]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d4c7cae-bd2f-4872-86e3-c7c2745f111b tempest-CreateVolumesFromImageTest-413827844 None] Lock "cinder-b740e5a2-782d-49d4-8b14-de9eb79ac64e-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:11 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a Jun 23 16:11:11 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:11 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.797s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-7eda896d-e0a7-4038-b015-ff162671a024 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-ee90bb83-6383-4612-90cb-4b82a4e1af63-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:12 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a" returned: 0 in 0.857s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:12 devstack sudo[113305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a Jun 23 16:11:12 devstack sudo[113305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:12 devstack sudo[113305]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-46294c23-8114-47a5-92a1-89a88d53db2a" returned: 0 in 0.702s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-46294c23-8114-47a5-92a1-89a88d53db2a" released by "delete_volume" :: held 1.617s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['328256bc-d8c7-484c-9aff-6ee95136b250', '1e766836-ed86-4341-b362-ec86a982d338', 'f4712b80-c813-4b05-818d-8a62614a7c39', 'adfe9392-bb8b-4f6a-8396-441831a6328e'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:12 devstack sudo[113308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:12 devstack sudo[113308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-18d82fac-41ca-45c1-848d-52fb4d779271-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-18d82fac-41ca-45c1-848d-52fb4d779271-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-18d82fac-41ca-45c1-848d-52fb4d779271" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-18d82fac-41ca-45c1-848d-52fb4d779271" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bda3d-d99c-4fe1-8e92-8eab65c4a328]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:13 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 Jun 23 16:11:13 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:13 devstack sudo[113308]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.675s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a26a18d4-14df-4064-96f4-66a26950efb9 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-46294c23-8114-47a5-92a1-89a88d53db2a-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:14 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271" returned: 0 in 0.775s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:14 devstack sudo[113316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271 Jun 23 16:11:14 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:14 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-18d82fac-41ca-45c1-848d-52fb4d779271" returned: 0 in 0.681s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-18d82fac-41ca-45c1-848d-52fb4d779271" released by "delete_volume" :: held 1.497s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['e734a4ea-af5c-4b3d-81c3-957f6ce4f2e1', '959a2705-6324-463a-b551-4fde5a3466f4', 'f395f759-80a0-4113-a19c-e9684b64f2ab', '0ae2e954-67cd-4e43-960b-3c3123d79c60'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:15 devstack sudo[113320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:15 devstack sudo[113320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-3b2378b9-9ef5-43bf-bcd3-01645904ad0a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-3b2378b9-9ef5-43bf-bcd3-01645904ad0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" acquired by "delete_volume" :: waited 0.014s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec94ae1-10f0-43dc-b0d4-4ce694720e0c]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:15 devstack sudo[113320]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.691s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:15 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:15 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-1f483969-a92e-4dc5-93e2-ad5afae6bb25 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-18d82fac-41ca-45c1-848d-52fb4d779271-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:15 devstack sudo[113323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a Jun 23 16:11:15 devstack sudo[113323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:16 devstack sudo[113323]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" returned: 0 in 0.770s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:16 devstack sudo[113328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a Jun 23 16:11:16 devstack sudo[113328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:17 devstack sudo[113328]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" returned: 0 in 0.660s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-3b2378b9-9ef5-43bf-bcd3-01645904ad0a" released by "delete_volume" :: held 1.474s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['bd650ef7-9dc4-4c05-9867-3241a1202a19', '00b6ea62-8875-43d9-8896-0562a6dce221', 'f96a65c5-0ea5-4af3-8e8d-79fea1bfeceb', 'abe33f36-7335-4845-aaf7-c18c18f2a28d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:17 devstack sudo[113331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:17 devstack sudo[113331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-2276ecb7-3680-4b6f-855c-59de18e31eb4-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-2276ecb7-3680-4b6f-855c-59de18e31eb4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "cinder-quobyte-2276ecb7-3680-4b6f-855c-59de18e31eb4" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-2276ecb7-3680-4b6f-855c-59de18e31eb4" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6dedbf-c7ea-4964-b043-51656c7e2135]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:17 devstack sudo[113331]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.745s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec4dd9f2-0b0d-4c0b-9ef0-5c5acfbb03e3 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-3b2378b9-9ef5-43bf-bcd3-01645904ad0a-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:18 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 Jun 23 16:11:18 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:18 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4" returned: 0 in 0.743s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:18 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4 Jun 23 16:11:18 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:19 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2276ecb7-3680-4b6f-855c-59de18e31eb4" returned: 0 in 0.669s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-quobyte-2276ecb7-3680-4b6f-855c-59de18e31eb4" released by "delete_volume" :: held 1.454s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Created reservations ['18b1be5f-23e0-41f6-9409-3d72a0fbe5ae', 'c10452a5-e11c-47cb-b3ae-69ba53be8656', 'a3e01a5a-cffd-46f3-8212-e28757b30b65', 'a57e2e1c-16a5-44bf-a856-a2b0e2eca5b2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:19 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:19 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:20 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.678s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Deleted volume successfully. Jun 23 16:11:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d0342c5c-4449-4cd1-9efc-a5ab0b9b4780 tempest-CreateVolumesFromSourceVolumeTest-1636429022 None] Lock "cinder-2276ecb7-3680-4b6f-855c-59de18e31eb4-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:29 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=77,cinder:INSERT=28,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:11:30 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=83,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=14 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Flow 'volume_create_manager' (1c8d0f05-2611-423e-96c6-d7b8fecc96a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb699fb-62c0-43f3-9f3a-ab6f345df1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb699fb-62c0-43f3-9f3a-ab6f345df1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-996574607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a20c1c-ed01-4190-90b8-7e281dc3bb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405e8cefc2584875ac5fde7e18d7882b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='2c25d5ac1ffd4af997a8f7d62b3ba7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f3412b-26c9-4b74-9219-8acde61a0e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f3412b-26c9-4b74-9219-8acde61a0e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17fffbf-d671-4e13-ab03-e7661f1cee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17fffbf-d671-4e13-ab03-e7661f1cee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a20c1c-ed01-4190-90b8-7e281dc3bb54', 'volume_name': 'volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c235a72-9300-4d8e-9d36-855da5736066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c235a72-9300-4d8e-9d36-855da5736066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ef81e-d4bf-4cef-970d-9f5e44b5e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:32 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Volume 10a20c1c-ed01-4190-90b8-7e281dc3bb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54', 'volume_size': 1} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-996574607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a20c1c-ed01-4190-90b8-7e281dc3bb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405e8cefc2584875ac5fde7e18d7882b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='2c25d5ac1ffd4af997a8f7d62b3ba7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Creating volume 10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:32 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:32 devstack sudo[113390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 1073741824 Jun 23 16:11:32 devstack sudo[113390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Flow 'volume_create_manager' (a0ec460b-8dff-4783-b192-38cd6262a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:32 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b3edd3-62b3-4a8e-8698-8e146a36a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b3edd3-62b3-4a8e-8698-8e146a36a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecb1e25-848e-4847-8dd2-4897e77058e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6119c817f243407db4e61ca196119297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='e3561f2c4b0944db89c1a762d0d199e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3453c740-e5cb-4b1c-935b-db9850ab24ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3453c740-e5cb-4b1c-935b-db9850ab24ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7320e8e-3a9a-4456-a04a-643fe4e5d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7320e8e-3a9a-4456-a04a-643fe4e5d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecb1e25-848e-4847-8dd2-4897e77058e8', 'volume_name': 'volume-5ecb1e25-848e-4847-8dd2-4897e77058e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01b325a-abf2-4e3b-8c2d-46b1d9df2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01b325a-abf2-4e3b-8c2d-46b1d9df2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d9e98d-ebe0-46da-b56a-48ae0f109676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Volume 5ecb1e25-848e-4847-8dd2-4897e77058e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecb1e25-848e-4847-8dd2-4897e77058e8', 'volume_size': 1} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (064b8590-82d3-4fef-b9f9-1e5a03eeb66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a09a5-abed-4ec2-9f7c-11f2ba05f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a09a5-abed-4ec2-9f7c-11f2ba05f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344241069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d66160-bf15-4784-a326-197a63af8217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d66160-bf15-4784-a326-197a63af8217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f793a-5243-4ee8-b3c6-5a24c7262f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434f793a-5243-4ee8-b3c6-5a24c7262f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3', 'volume_name': 'volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8311863b-54de-486f-b408-29d32fcd8024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8311863b-54de-486f-b408-29d32fcd8024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d53280e-185c-46ed-a14d-7537e947b267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:33 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume 32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3', 'volume_size': 1} Jun 23 16:11:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:34 devstack sudo[113390]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 1073741824" returned: 0 in 1.137s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:34 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:11:34 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:34 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 0.747s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecb1e25-848e-4847-8dd2-4897e77058e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6119c817f243407db4e61ca196119297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='e3561f2c4b0944db89c1a762d0d199e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Creating volume 5ecb1e25-848e-4847-8dd2-4897e77058e8 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:34 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ef81e-d4bf-4cef-970d-9f5e44b5e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:34 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 1073741824 Jun 23 16:11:34 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e50a7e-0212-4823-ae1a-aaeba364f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:34 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Volume volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 (10a20c1c-ed01-4190-90b8-7e281dc3bb54): created successfully Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e50a7e-0212-4823-ae1a-aaeba364f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:34 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Flow 'volume_create_manager' (1c8d0f05-2611-423e-96c6-d7b8fecc96a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:34 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4a69bb9c-5054-4709-ba3b-796432afe2f3 tempest-VolumeDependencyTests-799447207 None] Created volume successfully. Jun 23 16:11:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:36 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 1073741824" returned: 0 in 1.166s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:36 devstack sudo[113406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 Jun 23 16:11:36 devstack sudo[113406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:36 devstack sudo[113406]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8" returned: 0 in 0.756s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.178s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344241069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:33Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume 32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:36 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:36 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 1073741824 Jun 23 16:11:36 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d9e98d-ebe0-46da-b56a-48ae0f109676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecb1e25-848e-4847-8dd2-4897e77058e8', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8af3b4d-8691-41e9-9fb0-4ab60c97a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:36 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Volume volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 (5ecb1e25-848e-4847-8dd2-4897e77058e8): created successfully Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8af3b4d-8691-41e9-9fb0-4ab60c97a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:36 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Flow 'volume_create_manager' (a0ec460b-8dff-4783-b192-38cd6262a913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9ae4b496-461a-400c-8970-dfac917f9cfe tempest-CinderUnicodeTest-1541150849 None] Created volume successfully. Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Flow 'volume_create_manager' (4037a962-7353-4072-a08d-5cf955dd4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8308d2b-7c90-4f0d-8cdc-304a41435408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8308d2b-7c90-4f0d-8cdc-304a41435408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee6b2bc-1584-448d-a13b-e279003b9af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913c927eb1d48b1b57aa306046716d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:37Z,use_quota=True,user_id='f9bfec87777e4b8696b2a241e72a9c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f08171-661a-4797-9064-5ae8d6467f23),volume_type_id=a9f08171-661a-4797-9064-5ae8d6467f23)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72da0b08-603b-4233-830a-b46339be0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72da0b08-603b-4233-830a-b46339be0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bdc61f-b190-4bb4-bd18-5e4ba6208787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bdc61f-b190-4bb4-bd18-5e4ba6208787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ee6b2bc-1584-448d-a13b-e279003b9af9', 'volume_name': 'volume-6ee6b2bc-1584-448d-a13b-e279003b9af9', 'volume_size': 1, 'image_id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b6318b5e26e514cebde2fd9180047b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c913c927eb1d48b1b57aa306046716d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b24803dae27c0d05a75c99f9521e3726033d17b239fe4178bd91075130d7fd7eee0fda5a1747c2cba411714d69ebe92402b9408ec57d0a80aa9a0c03e99f6ccb', 'id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'created_at': datetime.datetime(2026, 6, 23, 14, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e2792b-aee4-466b-94c9-a15d2fccb5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e2792b-aee4-466b-94c9-a15d2fccb5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b3264c-6f84-47d3-95c4-3eca0f112f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:37 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Volume 6ee6b2bc-1584-448d-a13b-e279003b9af9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ee6b2bc-1584-448d-a13b-e279003b9af9', 'volume_size': 1, 'image_id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b6318b5e26e514cebde2fd9180047b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c913c927eb1d48b1b57aa306046716d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b24803dae27c0d05a75c99f9521e3726033d17b239fe4178bd91075130d7fd7eee0fda5a1747c2cba411714d69ebe92402b9408ec57d0a80aa9a0c03e99f6ccb', 'id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'created_at': datetime.datetime(2026, 6, 23, 14, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Trying to clone 6ee6b2bc-1584-448d-a13b-e279003b9af9 from image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:11:37 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc010a-f63c-45e6-b1ad-910ffa871e7c]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:37 devstack sudo[113413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:37 devstack sudo[113413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:37 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 1073741824" returned: 0 in 1.095s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:38 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 Jun 23 16:11:38 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Flow 'volume_create_manager' (962919a1-bd93-48df-bacb-2b3b3826e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5237807e-b9f4-481f-9114-88c2aba55e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5237807e-b9f4-481f-9114-88c2aba55e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330063138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3ba2b1-4c2b-412a-aca8-1916263e57a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6119c817f243407db4e61ca196119297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:38Z,use_quota=True,user_id='e3561f2c4b0944db89c1a762d0d199e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a65c9-12bd-4741-a8d2-d8463f7bc4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a65c9-12bd-4741-a8d2-d8463f7bc4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ce4b06-b16a-4a05-91f6-59bc18479802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ce4b06-b16a-4a05-91f6-59bc18479802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3ba2b1-4c2b-412a-aca8-1916263e57a3', 'volume_name': 'volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba244693-0c8b-4610-ac9c-a3fc1833abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba244693-0c8b-4610-ac9c-a3fc1833abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acbf0da-657e-4426-921a-d6dfc7c9ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Volume 2d3ba2b1-4c2b-412a-aca8-1916263e57a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3', 'volume_size': 1} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:38 devstack sudo[113413]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 0 in 1.053s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:38 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" returned: 0 in 0.725s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.786s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:38 devstack sudo[113422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:38 devstack sudo[113422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d53280e-185c-46ed-a14d-7537e947b267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4980850e-c99b-453e-a1e2-e8fd43cf9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Creating offline snapshot 16b1a604-94d2-4e15-a654-5430f00489b7 of volume 10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:11:38 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 (32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3): created successfully Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4980850e-c99b-453e-a1e2-e8fd43cf9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (064b8590-82d3-4fef-b9f9-1e5a03eeb66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[78133c10-3ed0-4d2c-8e52-439225da4282]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2a1db614-fe40-4251-aa85-64f67cde8a73 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:38 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:11:38 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:39 devstack sudo[113422]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 1 in 0.818s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Temporary image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb is fetched for user f9bfec87777e4b8696b2a241e72a9c7e. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[628a71ea-f28e-4e1a-a7e4-4fb78f41e79b]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:39 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:39 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:39 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 0.855s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:39 devstack sudo[113434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 1G Jun 23 16:11:39 devstack sudo[113434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:40 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (8cd209e9-4397-4eba-907f-8b88fe7a6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:40 devstack sudo[113440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:40 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94619ba5-626d-4ce0-a419-1b677afcf1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94619ba5-626d-4ce0-a419-1b677afcf1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11937146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1497ca-dc83-4046-9cb9-38690cd61a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:40Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1efa8f-a259-4bc4-a0e6-2957a6002fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1efa8f-a259-4bc4-a0e6-2957a6002fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67d1e25-cda5-4360-938a-6da6d94788ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67d1e25-cda5-4360-938a-6da6d94788ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1497ca-dc83-4046-9cb9-38690cd61a71', 'volume_name': 'volume-1d1497ca-dc83-4046-9cb9-38690cd61a71', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2adb812-5421-4f2f-b358-3940921d5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2adb812-5421-4f2f-b358-3940921d5a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b15fb1-4186-4a32-a2a8-5fd94c1d477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume 1d1497ca-dc83-4046-9cb9-38690cd61a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1497ca-dc83-4046-9cb9-38690cd61a71', 'volume_size': 1} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:40 devstack sudo[113434]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (a5191d99-bedb-4599-a229-8aebf8896074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac3ac5d-5f18-4970-94dc-43c01104e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 1G" returned: 0 in 1.267s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac3ac5d-5f18-4970-94dc-43c01104e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602388852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce51a3a2-7f08-42c4-b243-3be5031f8112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:41Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack sudo[113445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:11:40 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a5576-721b-4e1a-9748-6e9eac41d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a5576-721b-4e1a-9748-6e9eac41d070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:40 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376d142-8396-41af-86bc-a1f7fd34bcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376d142-8396-41af-86bc-a1f7fd34bcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce51a3a2-7f08-42c4-b243-3be5031f8112', 'volume_name': 'volume-ce51a3a2-7f08-42c4-b243-3be5031f8112', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c1bee-ef60-48fe-9951-40bc35ac3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9c1bee-ef60-48fe-9951-40bc35ac3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8e72f5-e882-48c2-911d-d660b7e4aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume ce51a3a2-7f08-42c4-b243-3be5031f8112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce51a3a2-7f08-42c4-b243-3be5031f8112', 'volume_size': 1} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (b9cbb170-fbf2-4958-8ec4-d44d1c96ed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dbdffc-7337-4dca-a9b8-3fc14115c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dbdffc-7337-4dca-a9b8-3fc14115c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827929951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a598f2-7662-46b1-b805-44ad7f165b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:41Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6a82a7-cd10-4c87-b635-dd236b679147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6a82a7-cd10-4c87-b635-dd236b679147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1a9bec-1099-465f-b0b8-cde0256c52df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1a9bec-1099-465f-b0b8-cde0256c52df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a598f2-7662-46b1-b805-44ad7f165b8c', 'volume_name': 'volume-a4a598f2-7662-46b1-b805-44ad7f165b8c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae6074-4e68-4a80-9cfd-0a853b919a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae6074-4e68-4a80-9cfd-0a853b919a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da36a27-22e5-40d4-999c-7802a638ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume a4a598f2-7662-46b1-b805-44ad7f165b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a598f2-7662-46b1-b805-44ad7f165b8c', 'volume_size': 1} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:41 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 1 in 1.104s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (73f1c5a4-4247-4b33-93aa-fcd254c51da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7c1958-0d24-4487-803d-fd0ff086eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7c1958-0d24-4487-803d-fd0ff086eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959773115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b804d180-5ff1-4a67-a8a7-b7928f92b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:42Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961be35e-70e6-4316-ab5c-e65117ace7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961be35e-70e6-4316-ab5c-e65117ace7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8621745-d338-401f-ab5c-e74c14321404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8621745-d338-401f-ab5c-e74c14321404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b804d180-5ff1-4a67-a8a7-b7928f92b172', 'volume_name': 'volume-b804d180-5ff1-4a67-a8a7-b7928f92b172', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6f6aef-74b8-4253-84ee-8689fb5f23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6f6aef-74b8-4253-84ee-8689fb5f23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68df56b-64d9-4064-b81b-671397e6e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume b804d180-5ff1-4a67-a8a7-b7928f92b172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b804d180-5ff1-4a67-a8a7-b7928f92b172', 'volume_size': 1} Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:41 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 1.001s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:41 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 is being set with open permissions: ugo+rw Jun 23 16:11:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:41 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:11:41 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (5fe542f3-5d92-40d2-b989-9eb9c9f4675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d9d507-7a09-4db0-8212-901744b9b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d9d507-7a09-4db0-8212-901744b9b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922717397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b388eef8-9854-45a1-ba3d-532ecba038ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:42Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42cf22-d4e5-4bc8-b3fe-88c57600cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42cf22-d4e5-4bc8-b3fe-88c57600cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1355c1b3-1be4-47cc-bbb7-aed1fb62c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1355c1b3-1be4-47cc-bbb7-aed1fb62c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b388eef8-9854-45a1-ba3d-532ecba038ae', 'volume_name': 'volume-b388eef8-9854-45a1-ba3d-532ecba038ae', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd8ea29-2d6b-44d7-b594-e46720bb7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd8ea29-2d6b-44d7-b594-e46720bb7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adbb5c-589d-42e9-b443-3675d7007f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:42 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume b388eef8-9854-45a1-ba3d-532ecba038ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b388eef8-9854-45a1-ba3d-532ecba038ae', 'volume_size': 1} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:42 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 0.704s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:42 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info Jun 23 16:11:42 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:43 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info" returned: 0 in 0.712s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:43 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info is being set with open permissions: ugo+rw Jun 23 16:11:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:43 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info Jun 23 16:11:43 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:44 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.info" returned: 0 in 0.629s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.310s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.424s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330063138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3ba2b1-4c2b-412a-aca8-1916263e57a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6119c817f243407db4e61ca196119297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:38Z,use_quota=True,user_id='e3561f2c4b0944db89c1a762d0d199e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Creating volume 2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:44 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:44 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 1073741824 Jun 23 16:11:44 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-47ef9c7e-cf22-4077-b9f7-3ac046c1f9ba tempest-VolumeDependencyTests-799447207 None] Create snapshot completed successfully Jun 23 16:11:44 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Flow 'volume_create_manager' (ebc24280-b3b7-46be-b930-0fbb8a89c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad6a9f-bede-4851-b3d2-6da376e6ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad6a9f-bede-4851-b3d2-6da376e6ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2024019997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='405e8cefc2584875ac5fde7e18d7882b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16b1a604-94d2-4e15-a654-5430f00489b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:45Z,use_quota=True,user_id='2c25d5ac1ffd4af997a8f7d62b3ba7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e8c862-4ef6-4319-8f35-9fdc88adc3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e8c862-4ef6-4319-8f35-9fdc88adc3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29162379-127b-47d1-ac27-39226fbbcb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29162379-127b-47d1-ac27-39226fbbcb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92', 'volume_name': 'volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92', 'volume_size': 1, 'snapshot_id': '16b1a604-94d2-4e15-a654-5430f00489b7'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02743b9-9b0e-4675-9f18-01c85df9f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02743b9-9b0e-4675-9f18-01c85df9f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dd618f-e51d-44bb-b85a-254b45e0c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Volume 4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92', 'volume_size': 1, 'snapshot_id': '16b1a604-94d2-4e15-a654-5430f00489b7'} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 1073741824" returned: 0 in 1.071s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:45 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 Jun 23 16:11:45 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:45 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" returned: 0 in 0.707s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.279s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11937146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1497ca-dc83-4046-9cb9-38690cd61a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:40Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume 1d1497ca-dc83-4046-9cb9-38690cd61a71 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:45 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:45 devstack sudo[113474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 1073741824 Jun 23 16:11:45 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acbf0da-657e-4426-921a-d6dfc7c9ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd39fc1-48bf-4c42-8583-3709c5f12a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:45 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Volume volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 (2d3ba2b1-4c2b-412a-aca8-1916263e57a3): created successfully Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd39fc1-48bf-4c42-8583-3709c5f12a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:45 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Flow 'volume_create_manager' (962919a1-bd93-48df-bacb-2b3b3826e809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:45 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-04ab9cbf-c151-4a53-8a55-6d3df5d44f89 tempest-CinderUnicodeTest-1541150849 None] Created volume successfully. Jun 23 16:11:46 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 1073741824" returned: 0 in 0.866s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:46 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 Jun 23 16:11:46 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:47 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71" returned: 0 in 0.758s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.532s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602388852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce51a3a2-7f08-42c4-b243-3be5031f8112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:41Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume ce51a3a2-7f08-42c4-b243-3be5031f8112 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:47 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b15fb1-4186-4a32-a2a8-5fd94c1d477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1497ca-dc83-4046-9cb9-38690cd61a71', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e98adc-c1ba-4cd4-868c-62072370fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:47 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 1073741824 Jun 23 16:11:47 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:47 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 (1d1497ca-dc83-4046-9cb9-38690cd61a71): created successfully Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e98adc-c1ba-4cd4-868c-62072370fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:47 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (8cd209e9-4397-4eba-907f-8b88fe7a6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:47 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d9e00473-b79a-47a4-9ee7-ee4da8033e53 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:48 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 1073741824" returned: 0 in 0.888s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:48 devstack sudo[113487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 Jun 23 16:11:48 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:49 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112" returned: 0 in 0.683s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.750s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827929951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a598f2-7662-46b1-b805-44ad7f165b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:41Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume a4a598f2-7662-46b1-b805-44ad7f165b8c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:49 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:49 devstack sudo[113490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c 1073741824 Jun 23 16:11:49 devstack sudo[113490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8e72f5-e882-48c2-911d-d660b7e4aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce51a3a2-7f08-42c4-b243-3be5031f8112', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90266ddc-d1b3-439f-9ce0-39a0734d91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:49 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 (ce51a3a2-7f08-42c4-b243-3be5031f8112): created successfully Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90266ddc-d1b3-439f-9ce0-39a0734d91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:49 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (a5191d99-bedb-4599-a229-8aebf8896074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-048c120b-cdd9-4fe9-8d1f-0b0f3eae17b3 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:50 devstack sudo[113490]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c 1073741824" returned: 0 in 0.921s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:50 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c Jun 23 16:11:50 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:50 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c" returned: 0 in 0.659s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.367s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee6b2bc-1584-448d-a13b-e279003b9af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913c927eb1d48b1b57aa306046716d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:37Z,use_quota=True,user_id='f9bfec87777e4b8696b2a241e72a9c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f08171-661a-4797-9064-5ae8d6467f23),volume_type_id=a9f08171-661a-4797-9064-5ae8d6467f23)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Creating volume 6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:50 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:50 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1073741824 Jun 23 16:11:50 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da36a27-22e5-40d4-999c-7802a638ff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a598f2-7662-46b1-b805-44ad7f165b8c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2593bdd-216d-4bc1-9077-dee4f3be128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-a4a598f2-7662-46b1-b805-44ad7f165b8c (a4a598f2-7662-46b1-b805-44ad7f165b8c): created successfully Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2593bdd-216d-4bc1-9077-dee4f3be128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (b9cbb170-fbf2-4958-8ec4-d44d1c96ed48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:50 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-1516433a-2716-4c21-ba3a-30fc1d169c04 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:51 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1073741824" returned: 0 in 0.868s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:51 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:11:51 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:52 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 0 in 0.652s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.490s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959773115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b804d180-5ff1-4a67-a8a7-b7928f92b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:42Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume b804d180-5ff1-4a67-a8a7-b7928f92b172 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:52 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:52 devstack sudo[113508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 1073741824 Jun 23 16:11:52 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Attempting download of 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}])) to volume 6ee6b2bc-1584-448d-a13b-e279003b9af9. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d6f42-b632-4f55-8ea5-a63087b5b678]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:52 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd Jun 23 16:11:52 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:53 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 1073741824" returned: 0 in 0.916s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:53 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd" returned: 0 in 0.844s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:53 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 Jun 23 16:11:53 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:53 devstack sudo[113518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd Jun 23 16:11:53 devstack sudo[113518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:54 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172" returned: 0 in 0.712s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.801s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922717397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b388eef8-9854-45a1-ba3d-532ecba038ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64354241eae949088a71cecbdef9dfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:11:42Z,use_quota=True,user_id='40280251c38a4590a2d64ce367aa06a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Creating volume b388eef8-9854-45a1-ba3d-532ecba038ae {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:54 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:54 devstack sudo[113561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae 1073741824 Jun 23 16:11:54 devstack sudo[113561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68df56b-64d9-4064-b81b-671397e6e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b804d180-5ff1-4a67-a8a7-b7928f92b172', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0c4886-9590-45a6-9cef-7d3489a06e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:54 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 (b804d180-5ff1-4a67-a8a7-b7928f92b172): created successfully Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0c4886-9590-45a6-9cef-7d3489a06e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (73f1c5a4-4247-4b33-93aa-fcd254c51da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:54 devstack sudo[113518]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd" returned: 1 in 0.837s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_yurzo0gd' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:11:54 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6eab28e4-05dc-439a-87b1-cd5a46f0376c tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1121c22-dcef-498c-bdab-7f5b8517074c]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:54 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:54 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:55 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:55 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD Jun 23 16:11:55 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:55 devstack sudo[113561]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae 1073741824" returned: 0 in 1.088s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:55 devstack sudo[113573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae Jun 23 16:11:55 devstack sudo[113573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:55 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb was raw, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:11:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:55 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:11:55 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:56 devstack sudo[113573]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae" returned: 0 in 0.768s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.873s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adbb5c-589d-42e9-b443-3675d7007f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b388eef8-9854-45a1-ba3d-532ecba038ae', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a573b47f-ebd8-46f3-8592-edd9719c4ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Creating volume 4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 from snapshot 16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:56 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Volume volume-b388eef8-9854-45a1-ba3d-532ecba038ae (b388eef8-9854-45a1-ba3d-532ecba038ae): created successfully Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a573b47f-ebd8-46f3-8592-edd9719c4ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Flow 'volume_create_manager' (5fe542f3-5d92-40d2-b989-9eb9c9f4675f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] snapshot: 16b1a604-94d2-4e15-a654-5430f00489b7, volume: 4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:11:56 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d7e2baee-f2db-4de5-948b-aa1dba660bcd tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created volume successfully. Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe7a3e-6ca4-429b-98a2-8561a92d1f5f]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:56 devstack sudo[113581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:11:56 devstack sudo[113581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-b388eef8-9854-45a1-ba3d-532ecba038ae-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-b388eef8-9854-45a1-ba3d-532ecba038ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-b388eef8-9854-45a1-ba3d-532ecba038ae" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-b388eef8-9854-45a1-ba3d-532ecba038ae" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c0070-7c19-4b04-a488-afa0ea9f445d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:56 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae Jun 23 16:11:56 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:56 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 0 in 0.925s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fc3f902-fc6f-4daa-9547-75e9b41bb8bb_065nvfmgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:11:56 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:11:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:56 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1G Jun 23 16:11:56 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:57 devstack sudo[113581]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 1.004s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efb3c0-cdaa-4945-b608-e329a53bed79]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:57 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:11:57 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:57 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae" returned: 0 in 0.975s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:57 devstack sudo[113598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae Jun 23 16:11:57 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:57 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 1G" returned: 0 in 0.888s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6447a4-5a7e-4fa9-974f-a23f1991ac7f]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:57 devstack sudo[113603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:11:57 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:58 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b388eef8-9854-45a1-ba3d-532ecba038ae" returned: 0 in 0.790s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:58 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-b388eef8-9854-45a1-ba3d-532ecba038ae" released by "delete_volume" :: held 1.812s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 1.052s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:58 devstack sudo[113609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 Jun 23 16:11:58 devstack sudo[113609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['637710ed-1f52-4fab-904d-6a9ca8d9a11e', '3bcbb567-26a9-4288-b309-bb26b95e1576', '46ceeac6-bc59-4168-93c8-4083551b28cd', 'b37188cc-9604-4d43-a3bd-a8cddccc67d2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:58 devstack sudo[113611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:11:58 devstack sudo[113611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-b804d180-5ff1-4a67-a8a7-b7928f92b172-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-b804d180-5ff1-4a67-a8a7-b7928f92b172-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-b804d180-5ff1-4a67-a8a7-b7928f92b172" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-b804d180-5ff1-4a67-a8a7-b7928f92b172" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:11:58 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 0 in 1.060s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a098dfc0-0eb2-43d5-9aa8-a90d7897c6c3]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:11:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:11:58 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:11:58 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:58 devstack sudo[113616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 Jun 23 16:11:58 devstack sudo[113616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:11:59 devstack sudo[113611]: pam_unix(sudo:session): session closed for user root Jun 23 16:11:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.808s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:11:59 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:11:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:11:59 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c8bb79cc-3b50-40c0-bbdc-275855c3aede tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-b388eef8-9854-45a1-ba3d-532ecba038ae-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:00 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 1 in 1.333s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Downloaded image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}])) to volume 6ee6b2bc-1584-448d-a13b-e279003b9af9 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Temporary image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb for user f9bfec87777e4b8696b2a241e72a9c7e is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Marking volume 6ee6b2bc-1584-448d-a13b-e279003b9af9 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Copying metadata from image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb to 6ee6b2bc-1584-448d-a13b-e279003b9af9. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Creating volume glance metadata for volume 6ee6b2bc-1584-448d-a13b-e279003b9af9 backed by image 5fc3f902-fc6f-4daa-9547-75e9b41bb8bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78b6318b5e26e514cebde2fd9180047b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:12:00 devstack sudo[113616]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172" returned: 0 in 1.569s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:00 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172 Jun 23 16:12:00 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b3264c-6f84-47d3-95c4-3eca0f112f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee6b2bc-1584-448d-a13b-e279003b9af9', 'volume_size': 1, 'image_id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b6318b5e26e514cebde2fd9180047b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c913c927eb1d48b1b57aa306046716d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b24803dae27c0d05a75c99f9521e3726033d17b239fe4178bd91075130d7fd7eee0fda5a1747c2cba411714d69ebe92402b9408ec57d0a80aa9a0c03e99f6ccb', 'id': '5fc3f902-fc6f-4daa-9547-75e9b41bb8bb', 'created_at': datetime.datetime(2026, 6, 23, 14, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fc3f902-fc6f-4daa-9547-75e9b41bb8bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31967bf7-e8ba-4630-8e90-b4e3fc119c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Volume volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 (6ee6b2bc-1584-448d-a13b-e279003b9af9): created successfully Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31967bf7-e8ba-4630-8e90-b4e3fc119c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Flow 'volume_create_manager' (4037a962-7353-4072-a08d-5cf955dd4f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:00 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ea07284a-7647-4040-bb39-a34e183ff37f tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Created volume successfully. Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Acquiring lock "cinder-6ee6b2bc-1584-448d-a13b-e279003b9af9-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "cinder-6ee6b2bc-1584-448d-a13b-e279003b9af9-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Acquiring lock "cinder-quobyte-6ee6b2bc-1584-448d-a13b-e279003b9af9" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "cinder-quobyte-6ee6b2bc-1584-448d-a13b-e279003b9af9" acquired by "delete_volume" :: waited 0.054s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3260f-e99a-4cf7-a451-729242e161e0]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:01 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-b804d180-5ff1-4a67-a8a7-b7928f92b172" returned: 0 in 1.498s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-b804d180-5ff1-4a67-a8a7-b7928f92b172" released by "delete_volume" :: held 3.181s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:02 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:12:02 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['01a21d09-87e4-407d-bf0b-6b5f7ae71343', '25725564-3272-4f56-a897-9d53321450bc', 'bbbbcbb5-a7f9-4f09-8edd-d855cc32904b', 'e432e457-95f8-46e4-af95-3537db7f9695'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:02 devstack sudo[113643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:02 devstack sudo[113643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-a4a598f2-7662-46b1-b805-44ad7f165b8c-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-a4a598f2-7662-46b1-b805-44ad7f165b8c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-a4a598f2-7662-46b1-b805-44ad7f165b8c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-a4a598f2-7662-46b1-b805-44ad7f165b8c" acquired by "delete_volume" :: waited 0.060s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b02abb-7389-4e80-957d-8ebc41b95436]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:03 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c Jun 23 16:12:03 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:03 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 0 in 2.241s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:04 devstack sudo[113643]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.804s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-da977568-9291-4495-9a8f-5392c93a54cf tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-b804d180-5ff1-4a67-a8a7-b7928f92b172-delete_volume" released by "delete_volume" :: held 5.606s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:04 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:12:04 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:04 devstack sudo[113609]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" returned: 0 in 6.624s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e7acf-6b58-43e3-908b-4e5f3cfe7221]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c" returned: 0 in 2.063s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:12:05 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c Jun 23 16:12:05 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 1 in 1.220s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9 Jun 23 16:12:05 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-a4a598f2-7662-46b1-b805-44ad7f165b8c" returned: 0 in 0.658s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-a4a598f2-7662-46b1-b805-44ad7f165b8c" released by "delete_volume" :: held 2.856s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['251640c7-db3e-4dc1-a35a-b13b4eba0af8', '755467e5-5f49-4688-b66d-469a60acb5de', 'ef27213b-aeb2-4433-8e61-1e79807cc6c2', '746ed9eb-8867-40bb-87d5-0c4764950317'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-6ee6b2bc-1584-448d-a13b-e279003b9af9" returned: 0 in 0.694s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:05 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:05 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "cinder-quobyte-6ee6b2bc-1584-448d-a13b-e279003b9af9" released by "delete_volume" :: held 4.314s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:05 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 1.023s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:12:05 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Converted 1024.00 MB image at 154.58 MB/s Jun 23 16:12:05 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 is being set with open permissions: ugo+rw Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:05 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:05 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 Jun 23 16:12:05 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:05 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Created reservations ['7028220e-8f1c-43dd-acd7-4aca594e9f2a', 'f3fa8828-5329-46d9-bd5d-b4961aac08b2', 'ec6d72e3-89d3-4d0d-938a-10a1627f78bd', 'fa30f6d3-078b-4df9-8ca5-aa50a6f424b8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:06 devstack sudo[113676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:06 devstack sudo[113676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-ce51a3a2-7f08-42c4-b243-3be5031f8112-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-ce51a3a2-7f08-42c4-b243-3be5031f8112-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-ce51a3a2-7f08-42c4-b243-3be5031f8112" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-ce51a3a2-7f08-42c4-b243-3be5031f8112" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66150c7-2de2-4283-8325-1bbdde989fb1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:06 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 Jun 23 16:12:06 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:06 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:06 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.043s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.005s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:06 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:12:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5e7845da-a294-4f91-89c2-7ffc0bc02cd7 tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-a4a598f2-7662-46b1-b805-44ad7f165b8c-delete_volume" released by "delete_volume" :: held 4.343s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 29 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:12:07 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" returned: 0 in 1.278s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" released by "_copy_volume_from_snapshot" :: held 11.119s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" released by "_create_volume_from_snapshot" :: held 11.177s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.217s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.910s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Creating offline snapshot cb1162b5-939d-4bcb-b96a-1e2764bbe8ff of volume 2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79dd618f-e51d-44bb-b85a-254b45e0c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92', 'volume_size': 1, 'snapshot_id': '16b1a604-94d2-4e15-a654-5430f00489b7'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5b5d0-ad2c-48a5-b64a-e5a8a0230e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b959ee-429a-4c8d-ad2d-aa5d05f3152a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:07 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Volume volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 (4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92): created successfully Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5b5d0-ad2c-48a5-b64a-e5a8a0230e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:07 devstack sudo[113676]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Flow 'volume_create_manager' (ebc24280-b3b7-46be-b930-0fbb8a89c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.291s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Deleted volume successfully. Jun 23 16:12:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c1c4faf5-589d-4f36-a080-ba0a2a7e0774 tempest-VolumeDependencyTests-799447207 None] Created volume successfully. Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0d53b502-1a77-40fb-818f-e31f3f9d85ee tempest-VolumeAndVolumeTypeFromImageTest-1499423046 None] Lock "cinder-6ee6b2bc-1584-448d-a13b-e279003b9af9-delete_volume" released by "delete_volume" :: held 6.035s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:07 devstack sudo[113687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 Jun 23 16:12:07 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:07 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112" returned: 0 in 1.164s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:07 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112 Jun 23 16:12:07 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-16b1a604-94d2-4e15-a654-5430f00489b7-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-16b1a604-94d2-4e15-a654-5430f00489b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:08 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-ce51a3a2-7f08-42c4-b243-3be5031f8112" returned: 0 in 0.834s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:08 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" returned: 0 in 1.024s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-ce51a3a2-7f08-42c4-b243-3be5031f8112" released by "delete_volume" :: held 2.068s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:08 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff 1G Jun 23 16:12:08 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Deleting offline snapshot 16b1a604-94d2-4e15-a654-5430f00489b7 of volume 10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] snapshot_file for this snap is: volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d71e09-5568-4cb5-a14c-6af46d116ac8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['4385d5d6-4f38-4cd7-a099-2f4886797990', 'e187ffd2-c918-401b-86b5-967aa0bfde80', '3feed275-c586-495e-ac5b-c48cb8cc364f', 'ac018b60-984e-4d46-834e-87dafb58ef16'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:08 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:12:08 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:08 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:08 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:09 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:09 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 1.117s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.983s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c6a81-dd43-4393-9dc8-33f977289b66]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-87d2620e-2b53-4c19-8483-ec3def97d40b tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-ce51a3a2-7f08-42c4-b243-3be5031f8112-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:09 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff 1G" returned: 0 in 1.358s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:09 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff Jun 23 16:12:09 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-1d1497ca-dc83-4046-9cb9-38690cd61a71-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-1d1497ca-dc83-4046-9cb9-38690cd61a71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:09 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:12:09 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-1d1497ca-dc83-4046-9cb9-38690cd61a71" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-1d1497ca-dc83-4046-9cb9-38690cd61a71" acquired by "delete_volume" :: waited 0.066s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbc8330-c835-47cc-9c20-a56ffb209e91]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:10 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 Jun 23 16:12:10 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:10 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 1.053s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:10 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" returned: 0 in 1.020s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:10 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff is being set with open permissions: ugo+rw Jun 23 16:12:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:10 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:12:10 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:10 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff Jun 23 16:12:10 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:11 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71" returned: 0 in 1.097s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:11 devstack sudo[113729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71 Jun 23 16:12:11 devstack sudo[113729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:11 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" returned: 0 in 0.872s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:11 devstack sudo[113737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info Jun 23 16:12:11 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:11 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 1.060s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:11 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7 Jun 23 16:12:11 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:11 devstack sudo[113729]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-1d1497ca-dc83-4046-9cb9-38690cd61a71" returned: 0 in 0.849s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-1d1497ca-dc83-4046-9cb9-38690cd61a71" released by "delete_volume" :: held 2.022s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['339b153b-c99e-4133-aa0f-a37249a5ba24', '3753f18c-15c9-454c-965f-7cd2ce39bf2b', '4d13fe21-70af-4512-b0c5-71bce6393b40', 'a43072f9-45a6-4ac9-8642-f4207c36ca15'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:12 devstack sudo[113742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:12 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:12 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info" returned: 0 in 0.927s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:12 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info is being set with open permissions: ugo+rw Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:12 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info Jun 23 16:12:12 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:12 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54.16b1a604-94d2-4e15-a654-5430f00489b7" returned: 0 in 0.949s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-16b1a604-94d2-4e15-a654-5430f00489b7" released by "_delete_snapshot" :: held 4.398s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" released by "delete_snapshot" :: held 4.438s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (c4133f7e-0189-4233-acbf-311bcc0b2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:12 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaf4751-6716-44a2-a1f7-56dd2595b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaf4751-6716-44a2-a1f7-56dd2595b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389516271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c312fa15-1dfc-486d-a758-e63dd021e62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:13Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5175b870-cbf5-4959-96b5-531930c09101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5175b870-cbf5-4959-96b5-531930c09101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec98179-2314-4c88-b6b4-0300d15d6417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec98179-2314-4c88-b6b4-0300d15d6417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c312fa15-1dfc-486d-a758-e63dd021e62c', 'volume_name': 'volume-c312fa15-1dfc-486d-a758-e63dd021e62c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b44dd4-a64a-4f30-a422-6c89bb697d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b44dd4-a64a-4f30-a422-6c89bb697d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b703fc99-5def-4562-a495-9e1cccde111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Volume c312fa15-1dfc-486d-a758-e63dd021e62c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c312fa15-1dfc-486d-a758-e63dd021e62c', 'volume_size': 1} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Created reservations ['ab9e7835-617d-4099-b01a-b90e25838fb2', '812ca5eb-80c9-4636-ad83-d8418018eea9', 'ba428cc0-ebd9-4f48-a265-ee3c3a447ec6', 'e3ca95af-f7e8-474d-96ea-8d8eec403437'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Delete snapshot completed successfully. Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9beda628-4da5-4624-9487-385b2fc558b8 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-16b1a604-94d2-4e15-a654-5430f00489b7-delete_snapshot" released by "delete_snapshot" :: held 4.855s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:13 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.033s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-609f5548-ab56-4188-8bde-511d08358c4a tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-1d1497ca-dc83-4046-9cb9-38690cd61a71-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "cinder-quobyte-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" acquired by "delete_volume" :: waited 0.023s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d42f75-897e-4849-b257-82874391961d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (26a04341-3882-4deb-863b-c079f8511b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6098a2-6501-4e80-aa35-ceb998ae86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6098a2-6501-4e80-aa35-ceb998ae86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714452188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da7531d-bd4c-4238-b7a6-06072ff0b384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:13Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8ef8bc-9a60-4ed5-b03d-5065fb7c400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8ef8bc-9a60-4ed5-b03d-5065fb7c400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68474bc-07ca-438e-8090-527d60e89b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68474bc-07ca-438e-8090-527d60e89b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da7531d-bd4c-4238-b7a6-06072ff0b384', 'volume_name': 'volume-8da7531d-bd4c-4238-b7a6-06072ff0b384', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133c4630-ab94-4ac6-9cef-76b770e84223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133c4630-ab94-4ac6-9cef-76b770e84223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6a8563-4714-4e61-afca-4d5edf33ae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Volume 8da7531d-bd4c-4238-b7a6-06072ff0b384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da7531d-bd4c-4238-b7a6-06072ff0b384', 'volume_size': 1} Jun 23 16:12:13 devstack sudo[113750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 Jun 23 16:12:13 devstack sudo[113750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.info" returned: 0 in 1.084s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.484s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389516271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c312fa15-1dfc-486d-a758-e63dd021e62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:13Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Creating volume c312fa15-1dfc-486d-a758-e63dd021e62c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-10a20c1c-ed01-4190-90b8-7e281dc3bb54-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:13 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c 1073741824 Jun 23 16:12:13 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-456e7651-9d0d-43d2-97b1-c50280c2a7d2 tempest-CinderUnicodeTest-1541150849 None] Create snapshot completed successfully Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "cinder-10a20c1c-ed01-4190-90b8-7e281dc3bb54-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" acquired by "delete_volume" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7138253-97c4-4e0a-9897-0176a1c23847]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:14 devstack sudo[113754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:12:14 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (b92989e6-625c-4a7a-a04a-859d815f03c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79cfe8-86df-4634-b5a7-61fed186782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79cfe8-86df-4634-b5a7-61fed186782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807316533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adebdd6-caa8-4dfa-b4b5-a6ba479f0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:14Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884c742d-8f77-4c1c-98fc-1f03efc14ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884c742d-8f77-4c1c-98fc-1f03efc14ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3c540f-17dc-4c50-a00d-666aebf21cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3c540f-17dc-4c50-a00d-666aebf21cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adebdd6-caa8-4dfa-b4b5-a6ba479f0036', 'volume_name': 'volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d12cc2-ec41-4f92-9d74-69083eb4bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d12cc2-ec41-4f92-9d74-69083eb4bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9295d51-851e-404f-a6c4-565829723e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:14 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Volume 5adebdd6-caa8-4dfa-b4b5-a6ba479f0036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036', 'volume_size': 1} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.151s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-quobyte-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Deleting offline snapshot cb1162b5-939d-4bcb-b96a-1e2764bbe8ff of volume 2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] snapshot_file for this snap is: volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde1ab6-1917-4f0e-8d03-2cb87c0bcbec]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:14 devstack sudo[113760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff Jun 23 16:12:14 devstack sudo[113760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:14 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (a3c09e1a-0e2d-436f-b1c1-1f8a79311d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4b9e37-8bbb-400c-99ef-9bd1b97e77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4b9e37-8bbb-400c-99ef-9bd1b97e77c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-587300241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fea6a27-3b49-41ba-b54a-08f593baee5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:15Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d29cbeb-b28e-4f3c-8448-11fa4182d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d29cbeb-b28e-4f3c-8448-11fa4182d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062332b8-f9b9-4511-8e23-daff3aaf077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062332b8-f9b9-4511-8e23-daff3aaf077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fea6a27-3b49-41ba-b54a-08f593baee5e', 'volume_name': 'volume-4fea6a27-3b49-41ba-b54a-08f593baee5e', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c8c450-5083-4b86-8c10-25362d7eedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c8c450-5083-4b86-8c10-25362d7eedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16f2f91-6e8a-4fb3-8306-73b783ce4fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Volume 4fea6a27-3b49-41ba-b54a-08f593baee5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fea6a27-3b49-41ba-b54a-08f593baee5e', 'volume_size': 1} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:15 devstack sudo[113750]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" returned: 0 in 1.632s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:15 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3 Jun 23 16:12:15 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:15 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 1.304s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:15 devstack sudo[113771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54 Jun 23 16:12:15 devstack sudo[113771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:15 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c 1073741824" returned: 0 in 1.750s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (9b9536f6-c4b0-4565-89a6-bc8db6510c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082376-e7d2-4e78-b34d-b1202911e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80082376-e7d2-4e78-b34d-b1202911e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410903806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c1b825-0852-4cd1-b69e-290d3e7706ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:15Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9784afa-844d-469f-9068-b8e948df7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9784afa-844d-469f-9068-b8e948df7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61083d18-b7c4-4cd9-b602-6d64315e2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61083d18-b7c4-4cd9-b602-6d64315e2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c1b825-0852-4cd1-b69e-290d3e7706ad', 'volume_name': 'volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58a1cf6-8a46-45e6-bf61-1c77b797b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58a1cf6-8a46-45e6-bf61-1c77b797b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf0c65c-11f4-4d77-bf1e-d95744952ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:15 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Volume c2c1b825-0852-4cd1-b69e-290d3e7706ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad', 'volume_size': 1} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:15 devstack sudo[113760]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" returned: 0 in 1.082s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db6bec-3444-43b8-8ab0-bfce698d47bc]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:16 devstack sudo[113778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 Jun 23 16:12:16 devstack sudo[113778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:16 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" returned: 0 in 0.955s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-quobyte-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3" released by "delete_volume" :: held 2.655s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Created reservations ['d7a85b50-b665-4960-95eb-8aee25821b91', 'fa035a57-59a3-49bd-8888-33f2a11cc864', 'b947acca-50ab-4b4c-9540-6a357e5acbb5', 'fa0eccdc-71cf-4638-9052-468d7a6253cf'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:16 devstack sudo[113771]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-10a20c1c-ed01-4190-90b8-7e281dc3bb54" returned: 0 in 0.858s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-10a20c1c-ed01-4190-90b8-7e281dc3bb54" released by "delete_volume" :: held 2.277s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:16 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:16 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Created reservations ['04ba50da-2ee6-43a1-ab3b-a113e5b4ab75', 'c972383e-6832-407e-9ed6-8460ec05dc83', 'b93ca44f-f964-4ea4-80ac-5dda42fd60d5', '50633d0e-f5cc-436b-a047-39218c9f13f8'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:16 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c" returned: 0 in 0.914s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] <== create_volume: return (2813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.818s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:16 devstack sudo[113785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714452188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da7531d-bd4c-4238-b7a6-06072ff0b384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:13Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:16 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Creating volume 8da7531d-bd4c-4238-b7a6-06072ff0b384 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:16 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:16 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 1073741824 Jun 23 16:12:16 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b703fc99-5def-4562-a495-9e1cccde111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c312fa15-1dfc-486d-a758-e63dd021e62c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e414dde-d945-496e-bad1-15aa904245b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:16 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Volume volume-c312fa15-1dfc-486d-a758-e63dd021e62c (c312fa15-1dfc-486d-a758-e63dd021e62c): created successfully Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e414dde-d945-496e-bad1-15aa904245b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (c4133f7e-0189-4233-acbf-311bcc0b2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:16 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-14eaa575-c75d-443a-b1e8-6eb791036550 tempest-CreateVolumesFromImageTest-103070220 None] Created volume successfully. Jun 23 16:12:16 devstack sudo[113778]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" returned: 0 in 0.945s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:16 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:16 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff Jun 23 16:12:16 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:17 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.972s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Deleted volume successfully. Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-db3aeafe-292b-4c3f-98c2-167439bdef1d tempest-CreateVolumesFromSourceVolumeTest-1158092309 None] Lock "cinder-32465bb3-c1a3-4ed0-8447-9e4f4bbc2ee3-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d17be73-1f79-4809-906b-4e558dc1decc]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:17 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.969s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:17 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Deleted volume successfully. Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-35140656-ce9f-417f-9ef1-7130c48d2c4f tempest-VolumeDependencyTests-799447207 None] Lock "cinder-10a20c1c-ed01-4190-90b8-7e281dc3bb54-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:17 devstack sudo[113796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 Jun 23 16:12:17 devstack sudo[113796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:17 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 1073741824" returned: 0 in 1.282s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:17 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 Jun 23 16:12:17 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:18 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" returned: 0 in 1.155s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:18 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff Jun 23 16:12:18 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:18 devstack sudo[113796]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" returned: 0 in 1.036s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:18 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92 Jun 23 16:12:18 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:18 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384" returned: 0 in 0.829s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1807316533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adebdd6-caa8-4dfa-b4b5-a6ba479f0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:14Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Creating volume 5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:18 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:18 devstack sudo[113819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 1073741824 Jun 23 16:12:18 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6a8563-4714-4e61-afca-4d5edf33ae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da7531d-bd4c-4238-b7a6-06072ff0b384', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b4ce21-f241-4713-b9a3-45234d923006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:18 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:18 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Volume volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 (8da7531d-bd4c-4238-b7a6-06072ff0b384): created successfully Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b4ce21-f241-4713-b9a3-45234d923006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (26a04341-3882-4deb-863b-c079f8511b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3.cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" returned: 0 in 0.909s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:18 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a06906e6-5b08-4e33-b6b0-87029f6850ac tempest-CreateVolumesFromImageTest-103070220 None] Created volume successfully. Jun 23 16:12:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff" released by "_delete_snapshot" :: held 4.264s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" released by "delete_snapshot" :: held 4.312s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Created reservations ['2b25dfc2-6783-47ba-8f90-30a52c2242a5', 'f17857ac-7be4-498a-9ec2-69e54e587eb3', '2a3df525-b605-43ab-89de-a0b1e80a5edd', '814a9d64-9f65-45d3-8dc0-b258192920ef'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Delete snapshot completed successfully. Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ec923c0e-d872-4bd2-8893-5ad10b205b78 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-cb1162b5-939d-4bcb-b96a-1e2764bbe8ff-delete_snapshot" released by "delete_snapshot" :: held 4.515s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:19 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" returned: 0 in 0.951s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-quobyte-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92" released by "delete_volume" :: held 2.047s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Created reservations ['9947cc85-58ad-422d-bd41-1bcccce38422', '11a90cdb-b6c8-4ad6-bf9c-c152a90bb735', 'f25832f7-8486-417e-9cc4-6e5a9d0897e6', 'a324f093-614d-4d64-b32e-56772da58d82'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:19 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:19 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 1073741824" returned: 0 in 1.219s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:19 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-2d3ba2b1-4c2b-412a-aca8-1916263e57a3-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:20 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 Jun 23 16:12:20 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-2d3ba2b1-4c2b-412a-aca8-1916263e57a3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e5a66-ad8e-42dd-a5b0-aac57a85d123]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:20 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.872s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:20 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Deleted volume successfully. Jun 23 16:12:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b33a4df6-e42b-4934-ac77-d1fc1be0ca29 tempest-VolumeDependencyTests-799447207 None] Lock "cinder-4f8f4c2c-e1ad-4138-be77-e0d8cc32ec92-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:20 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 Jun 23 16:12:20 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:21 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" returned: 0 in 0.970s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.967s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-587300241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fea6a27-3b49-41ba-b54a-08f593baee5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:15Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Creating volume 4fea6a27-3b49-41ba-b54a-08f593baee5e {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:21 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:21 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e 1073741824 Jun 23 16:12:21 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9295d51-851e-404f-a6c4-565829723e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301397d-ad58-4e03-9026-9582699ad508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:21 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Volume volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 (5adebdd6-caa8-4dfa-b4b5-a6ba479f0036): created successfully Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1301397d-ad58-4e03-9026-9582699ad508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (b92989e6-625c-4a7a-a04a-859d815f03c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:21 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-325cf52c-2d0e-49b5-8eda-c1af9d37d333 tempest-CreateVolumesFromImageTest-103070220 None] Created volume successfully. Jun 23 16:12:21 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" returned: 0 in 1.042s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:21 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3 Jun 23 16:12:21 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:22 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" returned: 0 in 0.835s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-2d3ba2b1-4c2b-412a-aca8-1916263e57a3" released by "delete_volume" :: held 1.977s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:22 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e 1073741824" returned: 0 in 1.170s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Created reservations ['9ede55ca-815d-4401-9cc2-c63489115a6c', 'f0756f2e-b1bb-4bdb-a448-35775bf286bc', '5748a6b5-85c2-4a54-a3f4-be19a8c65a28', 'ec9f961c-ceb5-434d-9e0c-39fbebb7c53a'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:22 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e Jun 23 16:12:22 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-5ecb1e25-848e-4847-8dd2-4897e77058e8-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:22 devstack sudo[113855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:22 devstack sudo[113855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-5ecb1e25-848e-4847-8dd2-4897e77058e8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "cinder-quobyte-5ecb1e25-848e-4847-8dd2-4897e77058e8" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-5ecb1e25-848e-4847-8dd2-4897e77058e8" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a8848-4e46-4e6f-8d37-13cd31f6eac8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:22 devstack sudo[113857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 Jun 23 16:12:22 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:23 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e" returned: 0 in 0.812s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.450s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410903806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c1b825-0852-4cd1-b69e-290d3e7706ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679f3f2de984a6eb27e9e410bbd51a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:15Z,use_quota=True,user_id='b7142105401041aa8e39cc982b83ec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Creating volume c2c1b825-0852-4cd1-b69e-290d3e7706ad {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:23 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:23 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad 1073741824 Jun 23 16:12:23 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16f2f91-6e8a-4fb3-8306-73b783ce4fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fea6a27-3b49-41ba-b54a-08f593baee5e', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db6db9e-12b9-4c30-8622-d80b720933bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:23 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Volume volume-4fea6a27-3b49-41ba-b54a-08f593baee5e (4fea6a27-3b49-41ba-b54a-08f593baee5e): created successfully Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db6db9e-12b9-4c30-8622-d80b720933bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (a3c09e1a-0e2d-436f-b1c1-1f8a79311d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:23 devstack sudo[113855]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.840s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Deleted volume successfully. Jun 23 16:12:23 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-4dce14b7-9203-4a44-9715-74459ccaaed9 tempest-CreateVolumesFromImageTest-103070220 None] Created volume successfully. Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-bd79ad73-e773-4024-8717-358a41e94b06 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-2d3ba2b1-4c2b-412a-aca8-1916263e57a3-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:23 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:23 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8 Jun 23 16:12:23 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:24 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad 1073741824" returned: 0 in 1.087s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:24 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad Jun 23 16:12:24 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:24 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5ecb1e25-848e-4847-8dd2-4897e77058e8" returned: 0 in 0.800s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-quobyte-5ecb1e25-848e-4847-8dd2-4897e77058e8" released by "delete_volume" :: held 1.843s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Created reservations ['dd94f046-85d1-4510-aada-f316f8a9ffc7', 'efd18774-6a15-4b35-8737-39372a45f31b', '534a0688-ecdb-4862-8d75-a3c95c907002', '225260fd-ef21-4163-a24b-6f707659f524'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Flow 'volume_create_manager' (2e397ce9-7d3e-434e-add9-6e431879fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5654702f-925a-4d2e-9d0f-12067919740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5654702f-925a-4d2e-9d0f-12067919740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596d29a1-58e7-48b2-93a6-fa045d0f6497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582c93e3111849a5b0c2658cdc993cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:25Z,use_quota=True,user_id='011f6fdecbdb4627b91b88f236ed2d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04980b7e-bfc8-4710-84f8-bbbbc59b5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04980b7e-bfc8-4710-84f8-bbbbc59b5003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4a1962-305c-4d90-a941-4a73ae52c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.image.glance [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Creating Keystone auth plugin from conf {{(pid=93590) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:24 devstack sudo[113875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:24 devstack sudo[113875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:25 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad" returned: 0 in 0.815s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf0c65c-11f4-4d77-bf1e-d95744952ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990fe2ad-4b03-4dff-8ddc-b426e22b80af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:25 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Volume volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad (c2c1b825-0852-4cd1-b69e-290d3e7706ad): created successfully Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990fe2ad-4b03-4dff-8ddc-b426e22b80af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Flow 'volume_create_manager' (9b9536f6-c4b0-4565-89a6-bc8db6510c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:25 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fca888d8-57d6-46b0-b4bb-f82ac37d06bf tempest-CreateVolumesFromImageTest-103070220 None] Created volume successfully. Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4a1962-305c-4d90-a941-4a73ae52c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '596d29a1-58e7-48b2-93a6-fa045d0f6497', 'volume_name': 'volume-596d29a1-58e7-48b2-93a6-fa045d0f6497', 'volume_size': 1, 'image_id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02af653dcd3f2116074ef1a0329a6fc7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582c93e3111849a5b0c2658cdc993cb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f8cc36931345f4a1d3e1ad83b621e2e870aad278fac450e0f9c7ba29116574df4aa87b90b5a9af2c5d6414645214169fb121419b24a36071f2d083519ddf302', 'id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'created_at': datetime.datetime(2026, 6, 23, 14, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fff112c-0282-4759-a19f-66cc0e71552f/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9221db-018e-4bfd-8892-bf176a60f3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9221db-018e-4bfd-8892-bf176a60f3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab7f17f-d992-4afe-8231-db439fd012f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:25 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Volume 596d29a1-58e7-48b2-93a6-fa045d0f6497: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-596d29a1-58e7-48b2-93a6-fa045d0f6497', 'volume_size': 1, 'image_id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02af653dcd3f2116074ef1a0329a6fc7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582c93e3111849a5b0c2658cdc993cb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f8cc36931345f4a1d3e1ad83b621e2e870aad278fac450e0f9c7ba29116574df4aa87b90b5a9af2c5d6414645214169fb121419b24a36071f2d083519ddf302', 'id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'created_at': datetime.datetime(2026, 6, 23, 14, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fff112c-0282-4759-a19f-66cc0e71552f/file', 'properties': {}}, 'image_service': } Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Trying to clone 596d29a1-58e7-48b2-93a6-fa045d0f6497 from image 5fff112c-0282-4759-a19f-66cc0e71552f at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}]). {{(pid=93590) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 16:12:25 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Image download 0.00 MB at 0.00 MB/s Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d592bf3-3aff-44a3-a3a5-c2a71cbb31d5]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:25 devstack sudo[113875]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.763s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:25 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Deleted volume successfully. Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-b9ed8f87-f459-4b9d-8220-3602b1459433 tempest-CinderUnicodeTest-1541150849 None] Lock "cinder-5ecb1e25-848e-4847-8dd2-4897e77058e8-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:25 devstack sudo[113879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:25 devstack sudo[113879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-c2c1b825-0852-4cd1-b69e-290d3e7706ad-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-c2c1b825-0852-4cd1-b69e-290d3e7706ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-quobyte-c2c1b825-0852-4cd1-b69e-290d3e7706ad" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-c2c1b825-0852-4cd1-b69e-290d3e7706ad" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7253119-b77c-4231-b417-395d57126452]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:26 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad Jun 23 16:12:26 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:26 devstack sudo[113879]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:26 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:26 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:26 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad" returned: 0 in 0.900s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:26 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad Jun 23 16:12:26 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:27 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 1 in 0.924s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Temporary image 5fff112c-0282-4759-a19f-66cc0e71552f is fetched for user 011f6fdecbdb4627b91b88f236ed2d9c. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e267d5f-50d5-43b4-bbe8-82cdbb41ad1d]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:27 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:27 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:27 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c2c1b825-0852-4cd1-b69e-290d3e7706ad" returned: 0 in 0.737s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-c2c1b825-0852-4cd1-b69e-290d3e7706ad" released by "delete_volume" :: held 1.698s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Created reservations ['bb0e17e6-1573-4ca3-91ad-0054ef5d1944', '819649bb-d608-4dcd-b2b8-707dbc59cdd4', '671b702e-903f-40e6-b14b-ecdbe0977776', '242cd201-4ded-41f1-9862-dc5e37d300c4'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:27 devstack sudo[113898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:27 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-4fea6a27-3b49-41ba-b54a-08f593baee5e-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-4fea6a27-3b49-41ba-b54a-08f593baee5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-quobyte-4fea6a27-3b49-41ba-b54a-08f593baee5e" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:28 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-4fea6a27-3b49-41ba-b54a-08f593baee5e" acquired by "delete_volume" :: waited 0.037s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe12a6-7ae8-4e83-bce8-9a29cf251c42]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:28 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:28 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:28 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e Jun 23 16:12:28 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:28 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.760s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:28 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Deleted volume successfully. Jun 23 16:12:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-945bd6e5-906d-49d8-a62f-e704b3c79ed9 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-c2c1b825-0852-4cd1-b69e-290d3e7706ad-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:29 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 1 in 0.933s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596d29a1-58e7-48b2-93a6-fa045d0f6497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582c93e3111849a5b0c2658cdc993cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:25Z,use_quota=True,user_id='011f6fdecbdb4627b91b88f236ed2d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Creating volume 596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:29 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:29 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e" returned: 0 in 0.895s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:29 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1073741824 Jun 23 16:12:29 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:29 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e Jun 23 16:12:29 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:30 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-4fea6a27-3b49-41ba-b54a-08f593baee5e" returned: 0 in 0.788s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-4fea6a27-3b49-41ba-b54a-08f593baee5e" released by "delete_volume" :: held 1.763s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:SELECT=109,cinder:UPDATE=161,cinder:INSERT=39,cinder:DELETE=15 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Created reservations ['410d187c-82f1-4c9d-bb6c-382052b74cf7', '80f91f99-63ee-4389-a323-eae61e906bf9', '94ced004-c55e-4013-ad49-03b4430746a1', '5d3d891b-d470-4e83-ab39-54a15a0efa7b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=161,cinder:SELECT=136,cinder:DELETE=15,cinder:INSERT=49 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:30 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:30 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:30 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1073741824" returned: 0 in 1.061s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:30 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:30 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-quobyte-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffab4e5-fbd6-4a12-83f0-f977cd39651d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:30 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:30 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 Jun 23 16:12:30 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:31 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 0 in 0.862s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Attempting download of 5fff112c-0282-4759-a19f-66cc0e71552f ((None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}])) to volume 596d29a1-58e7-48b2-93a6-fa045d0f6497. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 16:12:31 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.026s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:31 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Deleted volume successfully. Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-ecaaa79b-5dbd-4208-8e26-6fd069430be2 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-4fea6a27-3b49-41ba-b54a-08f593baee5e-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[63860219-8a0c-4158-951b-3005a93c3966]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_ {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:31 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_ Jun 23 16:12:31 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:31 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" returned: 0 in 1.030s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:31 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:31 devstack sudo[113934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036 Jun 23 16:12:31 devstack sudo[113934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:32 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_" returned: 0 in 0.843s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_ {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:32 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_ Jun 23 16:12:32 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:32 devstack sudo[113934]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" returned: 0 in 0.790s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036" released by "delete_volume" :: held 1.881s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Created reservations ['d646731b-2e5d-4a25-afe6-ee330b0cc5b8', 'a53ffc48-9f71-4966-8d63-fc68c0f0c55b', '8fa3f716-3cb7-49dd-ba41-43ec67f51da2', 'd4762949-5ffc-43a1-b570-7f38169d5a13'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:32 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:32 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-8da7531d-bd4c-4238-b7a6-06072ff0b384-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:32 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-8da7531d-bd4c-4238-b7a6-06072ff0b384-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-quobyte-8da7531d-bd4c-4238-b7a6-06072ff0b384" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:33 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-8da7531d-bd4c-4238-b7a6-06072ff0b384" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_" returned: 1 in 0.896s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fff112c-0282-4759-a19f-66cc0e71552f_h5qy_wu_' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c12131-2dbf-4b9a-b7e9-a16abfb61244]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddabe1eb-d006-46df-ad4d-011f01f93705]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:33 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:33 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:33 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 Jun 23 16:12:33 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:33 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.831s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:33 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Deleted volume successfully. Jun 23 16:12:33 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-96ab04fe-4f3c-4b55-943a-fb8712488f16 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-5adebdd6-caa8-4dfa-b4b5-a6ba479f0036-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:34 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 0 in 1.074s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:34 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384" returned: 0 in 1.089s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:34 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384 Jun 23 16:12:34 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:34 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD Jun 23 16:12:34 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:34 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:34 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] 5fff112c-0282-4759-a19f-66cc0e71552f was raw, converting to raw {{(pid=93590) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 16:12:34 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8da7531d-bd4c-4238-b7a6-06072ff0b384" returned: 0 in 0.813s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:35 devstack sudo[113964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:35 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-8da7531d-bd4c-4238-b7a6-06072ff0b384" released by "delete_volume" :: held 1.962s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Created reservations ['fdd94407-7010-46e0-b272-b6e89c477d21', 'fa8bb5c9-4a4c-45da-9110-ae5a37fea1dd', 'b9c2e44f-007d-420f-bf70-8b8637e85f0c', '471b39b7-337d-4233-aa71-97e4c04d568d'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:35 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:35 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-c312fa15-1dfc-486d-a758-e63dd021e62c-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-c312fa15-1dfc-486d-a758-e63dd021e62c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "cinder-quobyte-c312fa15-1dfc-486d-a758-e63dd021e62c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-c312fa15-1dfc-486d-a758-e63dd021e62c" acquired by "delete_volume" :: waited 0.027s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7015c3-1dc3-4e3a-bb25-14cff60e8923]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:35 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:35 devstack sudo[113968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c Jun 23 16:12:35 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:36 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 0 in 1.094s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fff112c-0282-4759-a19f-66cc0e71552f_e0dgvefpdevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:12:36 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:36 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.929s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:36 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1G Jun 23 16:12:36 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:36 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Deleted volume successfully. Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-5590f974-ef95-4095-a4e2-648b784aba40 tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-8da7531d-bd4c-4238-b7a6-06072ff0b384-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:36 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c" returned: 0 in 0.992s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:36 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:36 devstack sudo[113979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c Jun 23 16:12:36 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:37 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 1G" returned: 0 in 0.954s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e2e98-ee79-47c3-a78a-d91c5c0f7e99]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:37 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:37 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:37 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-c312fa15-1dfc-486d-a758-e63dd021e62c" returned: 0 in 0.814s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-quobyte-c312fa15-1dfc-486d-a758-e63dd021e62c" released by "delete_volume" :: held 1.868s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Created reservations ['41fbf6e0-1533-4c6a-999f-99a0c9d9a6bf', '639db6b4-63d4-4e52-9da7-14a6b3c553e6', '671a716f-38b3-4e3b-8c5b-f2692b24fabd', '350fb32b-ae21-4435-9c53-c83fb6775b6b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:37 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:37 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:37 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:38 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 0 in 1.012s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:38 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:38 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.810s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:38 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:38 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Deleted volume successfully. Jun 23 16:12:38 devstack sudo[113992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:38 devstack sudo[113992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:38 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-a538ab14-55db-4059-8087-99c05fa50f8b tempest-CreateVolumesFromImageTest-103070220 None] Lock "cinder-c312fa15-1dfc-486d-a758-e63dd021e62c-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:39 devstack sudo[113992]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 1 in 1.007s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Downloaded image 5fff112c-0282-4759-a19f-66cc0e71552f ((None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}])) to volume 596d29a1-58e7-48b2-93a6-fa045d0f6497 successfully. {{(pid=93590) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Temporary image 5fff112c-0282-4759-a19f-66cc0e71552f for user 011f6fdecbdb4627b91b88f236ed2d9c is deleted. {{(pid=93590) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.volume_utils [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Marking volume 596d29a1-58e7-48b2-93a6-fa045d0f6497 as bootable. {{(pid=93590) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Copying metadata from image 5fff112c-0282-4759-a19f-66cc0e71552f to 596d29a1-58e7-48b2-93a6-fa045d0f6497. {{(pid=93590) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Creating volume glance metadata for volume 596d29a1-58e7-48b2-93a6-fa045d0f6497 backed by image 5fff112c-0282-4759-a19f-66cc0e71552f with: {'image_id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '02af653dcd3f2116074ef1a0329a6fc7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93590) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab7f17f-d992-4afe-8231-db439fd012f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596d29a1-58e7-48b2-93a6-fa045d0f6497', 'volume_size': 1, 'image_id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fff112c-0282-4759-a19f-66cc0e71552f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '02af653dcd3f2116074ef1a0329a6fc7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '582c93e3111849a5b0c2658cdc993cb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f8cc36931345f4a1d3e1ad83b621e2e870aad278fac450e0f9c7ba29116574df4aa87b90b5a9af2c5d6414645214169fb121419b24a36071f2d083519ddf302', 'id': '5fff112c-0282-4759-a19f-66cc0e71552f', 'created_at': datetime.datetime(2026, 6, 23, 14, 12, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 14, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fff112c-0282-4759-a19f-66cc0e71552f/file', 'properties': {}}, 'image_service': }' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9445ae-4109-42e8-8a18-901e2f00fe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:39 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Volume volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 (596d29a1-58e7-48b2-93a6-fa045d0f6497): created successfully Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9445ae-4109-42e8-8a18-901e2f00fe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Flow 'volume_create_manager' (2e397ce9-7d3e-434e-add9-6e431879fe27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:39 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c954d2e2-9eff-49ab-ba5d-3e9f98fa4f54 tempest-VolumeImageDependencyTests-1950014075 None] Created volume successfully. Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Acquiring lock "cinder-596d29a1-58e7-48b2-93a6-fa045d0f6497-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:39 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "cinder-596d29a1-58e7-48b2-93a6-fa045d0f6497-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Acquiring lock "cinder-quobyte-596d29a1-58e7-48b2-93a6-fa045d0f6497" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:12:40 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "cinder-quobyte-596d29a1-58e7-48b2-93a6-fa045d0f6497" acquired by "delete_volume" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:12:40 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f1e06-7e92-4583-9a0b-f3501d55a22a]: (4, 'raw') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:40 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:40 devstack sudo[113997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:40 devstack sudo[113997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:41 devstack sudo[113997]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 0 in 1.025s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:41 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:41 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (df74b7ff-bf02-4dee-be56-05d70efa3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e003-f357-4738-8936-66a97e623211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e003-f357-4738-8936-66a97e623211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123878675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81efb797-a549-41ce-8fbc-6f51bbfbc08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:41Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9684c1e8-a8e9-4509-bd4d-40db7fcedd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9684c1e8-a8e9-4509-bd4d-40db7fcedd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64dbd3e-543d-4f36-8461-649ab8032461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64dbd3e-543d-4f36-8461-649ab8032461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81efb797-a549-41ce-8fbc-6f51bbfbc08b', 'volume_name': 'volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1218fb34-cc18-48ec-9c75-39e2eb21f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1218fb34-cc18-48ec-9c75-39e2eb21f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43a7bce-ab3f-4c18-b986-4a7db17e377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:41 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 81efb797-a549-41ce-8fbc-6f51bbfbc08b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b', 'volume_size': 1} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123878675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81efb797-a549-41ce-8fbc-6f51bbfbc08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:41Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:41 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:41 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:41 devstack sudo[114004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b 1073741824 Jun 23 16:12:41 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:42 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 1 in 0.878s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497' failed. Not Retrying. {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:42 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497 Jun 23 16:12:42 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:42 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b 1073741824" returned: 0 in 0.971s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:42 devstack sudo[114016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b Jun 23 16:12:42 devstack sudo[114016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:42 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-596d29a1-58e7-48b2-93a6-fa045d0f6497" returned: 0 in 0.817s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "cinder-quobyte-596d29a1-58e7-48b2-93a6-fa045d0f6497" released by "delete_volume" :: held 2.805s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:42 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Created reservations ['cba6ac3e-34eb-4184-afb5-59fd9d5ef615', '779b4b40-573e-45fc-b94b-83ef25e77012', '8358adff-0440-49b7-8870-c6c374b52b68', 'a5578387-f1a1-4223-ab1d-94a2599797f2'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:43 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:12:43 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:43 devstack sudo[114016]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b" returned: 0 in 0.769s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43a7bce-ab3f-4c18-b986-4a7db17e377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7729a1d0-6cac-42eb-a680-9201f2b4a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:43 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b (81efb797-a549-41ce-8fbc-6f51bbfbc08b): created successfully Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7729a1d0-6cac-42eb-a680-9201f2b4a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (df74b7ff-bf02-4dee-be56-05d70efa3536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:43 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3b29206a-4e75-42d5-98c1-22f55455c335 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating offline snapshot b3854694-b510-4052-92b9-b9a2e753f8a8 of volume 81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a2bb7-cb30-4700-ab2e-83859b086ea8]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:12:43 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:44 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.029s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:44 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:12:44 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Deleted volume successfully. Jun 23 16:12:44 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-6a259568-0eb7-4844-82bd-fb9aa65142c6 tempest-VolumeImageDependencyTests-1950014075 None] Lock "cinder-596d29a1-58e7-48b2-93a6-fa045d0f6497-delete_volume" released by "delete_volume" :: held 4.130s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:12:44 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b Jun 23 16:12:44 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:44 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b" returned: 0 in 0.989s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:44 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:45 devstack sudo[114031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 1G Jun 23 16:12:45 devstack sudo[114031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:46 devstack sudo[114031]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 1G" returned: 0 in 1.123s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:46 devstack sudo[114037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 Jun 23 16:12:46 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:46 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8" returned: 0 in 0.805s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:46 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 is being set with open permissions: ugo+rw Jun 23 16:12:46 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:46 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 Jun 23 16:12:46 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:47 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8" returned: 0 in 0.751s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:47 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:47 devstack sudo[114045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info Jun 23 16:12:47 devstack sudo[114045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:48 devstack sudo[114045]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info" returned: 0 in 0.756s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:48 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info is being set with open permissions: ugo+rw Jun 23 16:12:48 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:48 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info Jun 23 16:12:48 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:49 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.info" returned: 0 in 0.868s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:49 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.438s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:49 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-555946ac-b884-4beb-bc1e-9872b9f4e5e4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Create snapshot completed successfully Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (18b02077-a383-4679-8552-38ccce92f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f01e7-f77a-4bd9-9136-21ccd561421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f01e7-f77a-4bd9-9136-21ccd561421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218772783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38094736-f321-4a05-be26-01e18c1ab5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:51Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7f0537-ab44-4b32-a206-adb0c89ffd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7f0537-ab44-4b32-a206-adb0c89ffd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b33527b-17cb-4135-8247-da12001fab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b33527b-17cb-4135-8247-da12001fab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38094736-f321-4a05-be26-01e18c1ab5f6', 'volume_name': 'volume-38094736-f321-4a05-be26-01e18c1ab5f6', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9e253b-0940-4513-83cc-0d561fd2727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9e253b-0940-4513-83cc-0d561fd2727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be87c680-3754-4092-a438-285abb0b5c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:50 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 38094736-f321-4a05-be26-01e18c1ab5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38094736-f321-4a05-be26-01e18c1ab5f6', 'volume_size': 1} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218772783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38094736-f321-4a05-be26-01e18c1ab5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:51Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:50 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 38094736-f321-4a05-be26-01e18c1ab5f6 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:51 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:51 devstack sudo[114051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 1073741824 Jun 23 16:12:51 devstack sudo[114051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (a1702bcc-28fb-4cc1-a07d-856eb17cb1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f60e2a-8a57-4f82-8947-bef93ac1a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f60e2a-8a57-4f82-8947-bef93ac1a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98650788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6196ec-1967-4f97-98a5-34fb7efb083a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:51Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b023426f-fbef-4ff5-80e1-8f4034c84486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b023426f-fbef-4ff5-80e1-8f4034c84486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864941df-5251-46e6-863b-c03f8628f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864941df-5251-46e6-863b-c03f8628f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6196ec-1967-4f97-98a5-34fb7efb083a', 'volume_name': 'volume-8c6196ec-1967-4f97-98a5-34fb7efb083a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8a9585-f987-4d8f-a2c4-1dbc588df079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8a9585-f987-4d8f-a2c4-1dbc588df079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d66ee-5a18-4adb-bbe6-650eb6ac73b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 8c6196ec-1967-4f97-98a5-34fb7efb083a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6196ec-1967-4f97-98a5-34fb7efb083a', 'volume_size': 1} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (20347cf8-cf24-43b2-aebc-c301cf145391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36dcdb9-bf64-447c-acc8-a88e3d3cd4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36dcdb9-bf64-447c-acc8-a88e3d3cd4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894361447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6d7e60-d35f-4c94-91a9-dad8951d9209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:52Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb87d5e-7e07-40f8-a4c7-30b8c521a2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb87d5e-7e07-40f8-a4c7-30b8c521a2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab715ddf-7648-42b7-a697-addcc7edfe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:51 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab715ddf-7648-42b7-a697-addcc7edfe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6d7e60-d35f-4c94-91a9-dad8951d9209', 'volume_name': 'volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d183ee6-3556-4081-abac-ec68536ed65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d183ee6-3556-4081-abac-ec68536ed65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90bf5c4-ff58-41a3-be1c-927d07e16f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 9f6d7e60-d35f-4c94-91a9-dad8951d9209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209', 'volume_size': 1} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (c851c2ae-fecf-4d75-a191-a776236049ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939617c-f1f7-4ed8-a6a2-281dbc4f4840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939617c-f1f7-4ed8-a6a2-281dbc4f4840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245140905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dffcd-6e00-4577-a343-26ef13d8c89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:52Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack sudo[114051]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace0e2f1-4ec0-4ccf-a5fe-962698253bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace0e2f1-4ec0-4ccf-a5fe-962698253bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4865a429-15ce-41b0-a0b8-1232124f2ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4865a429-15ce-41b0-a0b8-1232124f2ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3dffcd-6e00-4577-a343-26ef13d8c89b', 'volume_name': 'volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ec0482-8627-476e-9bd1-817850ed963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ec0482-8627-476e-9bd1-817850ed963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad1cc9-7242-4a5b-8681-101ad6fa8a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:52 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 5e3dffcd-6e00-4577-a343-26ef13d8c89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b', 'volume_size': 1} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 1073741824" returned: 0 in 1.659s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:52 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:52 devstack sudo[114056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 Jun 23 16:12:52 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (21b37cb8-827d-43c6-b0a4-f546b30b2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d96b2-dbb4-4f94-b17d-7a0c99fdcf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d96b2-dbb4-4f94-b17d-7a0c99fdcf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736718761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a76276-6fc0-413a-8702-7de8d83d0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:53Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370dd7af-58a0-47cb-b70e-789f235d8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370dd7af-58a0-47cb-b70e-789f235d8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df5c1d4-e95f-446c-8797-6fb8647ec7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df5c1d4-e95f-446c-8797-6fb8647ec7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a76276-6fc0-413a-8702-7de8d83d0ed0', 'volume_name': 'volume-41a76276-6fc0-413a-8702-7de8d83d0ed0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd653d-c6fe-4555-85ef-6784e84d12e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd653d-c6fe-4555-85ef-6784e84d12e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44292b55-e8ca-42c8-9f0f-9304bf6304fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume 41a76276-6fc0-413a-8702-7de8d83d0ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a76276-6fc0-413a-8702-7de8d83d0ed0', 'volume_size': 1} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:53 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6" returned: 0 in 0.971s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (2704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.708s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98650788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6196ec-1967-4f97-98a5-34fb7efb083a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:51Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 8c6196ec-1967-4f97-98a5-34fb7efb083a {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:53 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be87c680-3754-4092-a438-285abb0b5c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38094736-f321-4a05-be26-01e18c1ab5f6', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a 1073741824 Jun 23 16:12:53 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495c132-37d5-4537-96de-81a6ff85d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:53 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-38094736-f321-4a05-be26-01e18c1ab5f6 (38094736-f321-4a05-be26-01e18c1ab5f6): created successfully Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d495c132-37d5-4537-96de-81a6ff85d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:53 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (18b02077-a383-4679-8552-38ccce92f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:53 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8e834e77-0545-4ba7-82cb-99ad72af2f40 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Flow 'volume_create_manager' (ce59ebdb-2028-4725-918f-f88f4e81dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df57cdcf-31d4-449d-a697-111db1dd34a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df57cdcf-31d4-449d-a697-111db1dd34a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1735004140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976a8358-0243-4cb8-9c97-06f79594158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1c0db0eb5d493b922fb0dbb50bb1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:55Z,use_quota=True,user_id='9dadf51564d848e4a650f5fce40c81c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c5122-19c2-47c0-ba65-c6970493ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c5122-19c2-47c0-ba65-c6970493ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1458e-e89f-4095-ace9-de8afb92b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:54 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1458e-e89f-4095-ace9-de8afb92b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976a8358-0243-4cb8-9c97-06f79594158c', 'volume_name': 'volume-976a8358-0243-4cb8-9c97-06f79594158c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aada412c-2789-45d2-8888-33be008944f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aada412c-2789-45d2-8888-33be008944f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f0ed33-1cf1-43df-9435-2efd7403d4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:54 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Volume 976a8358-0243-4cb8-9c97-06f79594158c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976a8358-0243-4cb8-9c97-06f79594158c', 'volume_size': 1} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a 1073741824" returned: 0 in 1.002s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:54 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:54 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a Jun 23 16:12:54 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:55 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a" returned: 0 in 0.680s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.419s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894361447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6d7e60-d35f-4c94-91a9-dad8951d9209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:52Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 9f6d7e60-d35f-4c94-91a9-dad8951d9209 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:55 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d66ee-5a18-4adb-bbe6-650eb6ac73b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6196ec-1967-4f97-98a5-34fb7efb083a', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:55 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 1073741824 Jun 23 16:12:55 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2065c1cc-4ece-4ce8-8070-c58ce753929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:55 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-8c6196ec-1967-4f97-98a5-34fb7efb083a (8c6196ec-1967-4f97-98a5-34fb7efb083a): created successfully Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2065c1cc-4ece-4ce8-8070-c58ce753929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:55 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (a1702bcc-28fb-4cc1-a07d-856eb17cb1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:55 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-daf6a96a-88c3-429f-ba41-11caaadda86f tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:12:56 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 1073741824" returned: 0 in 0.970s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:56 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:56 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 Jun 23 16:12:56 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:57 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209" returned: 0 in 0.715s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245140905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3dffcd-6e00-4577-a343-26ef13d8c89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:52Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 5e3dffcd-6e00-4577-a343-26ef13d8c89b {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:57 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:57 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b 1073741824 Jun 23 16:12:57 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90bf5c4-ff58-41a3-be1c-927d07e16f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf919827-c996-4beb-9280-71615de12eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:57 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 (9f6d7e60-d35f-4c94-91a9-dad8951d9209): created successfully Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf919827-c996-4beb-9280-71615de12eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:57 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (20347cf8-cf24-43b2-aebc-c301cf145391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:57 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-c20866df-5989-4fe9-b577-73c3a9549322 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:12:58 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b 1073741824" returned: 0 in 1.087s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:58 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:58 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b Jun 23 16:12:58 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:59 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b" returned: 0 in 0.727s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.845s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736718761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a76276-6fc0-413a-8702-7de8d83d0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80dd5a45d1a4e8faf2dea3eacc41cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:53Z,use_quota=True,user_id='8076771d7b7d4dd68408d470e35ab085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Creating volume 41a76276-6fc0-413a-8702-7de8d83d0ed0 {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:12:59 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:12:59 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 1073741824 Jun 23 16:12:59 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad1cc9-7242-4a5b-8681-101ad6fa8a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3063b-84e9-429e-9b67-f27d0250c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:12:59 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b (5e3dffcd-6e00-4577-a343-26ef13d8c89b): created successfully Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be3063b-84e9-429e-9b67-f27d0250c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:12:59 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (c851c2ae-fecf-4d75-a191-a776236049ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:12:59 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-8e0bb9f2-0675-4a20-a125-7442a5f117f6 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:13:00 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 1073741824" returned: 0 in 1.081s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:00 devstack sudo[114130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 Jun 23 16:13:00 devstack sudo[114130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:00 devstack sudo[114130]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0" returned: 0 in 0.703s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.175s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1735004140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976a8358-0243-4cb8-9c97-06f79594158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1c0db0eb5d493b922fb0dbb50bb1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:12:55Z,use_quota=True,user_id='9dadf51564d848e4a650f5fce40c81c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)}" {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Creating volume 976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:13:00 devstack cinder-volume[93590]: INFO cinder.volume.drivers.remotefs [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] casted to osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c 1073741824 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44292b55-e8ca-42c8-9f0f-9304bf6304fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a76276-6fc0-413a-8702-7de8d83d0ed0', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693c7ac8-f661-43c9-9aa1-f0a59d75bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:00 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c 1073741824 Jun 23 16:13:00 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:00 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Volume volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 (41a76276-6fc0-413a-8702-7de8d83d0ed0): created successfully Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693c7ac8-f661-43c9-9aa1-f0a59d75bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:00 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Flow 'volume_create_manager' (21b37cb8-827d-43c6-b0a4-f546b30b2574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:13:01 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-6428f6d2-19de-412f-8263-7d8cb3fb211d tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created volume successfully. Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-41a76276-6fc0-413a-8702-7de8d83d0ed0-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-41a76276-6fc0-413a-8702-7de8d83d0ed0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-41a76276-6fc0-413a-8702-7de8d83d0ed0" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-41a76276-6fc0-413a-8702-7de8d83d0ed0" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:01 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c 1073741824" returned: 0 in 1.065s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca26d10-c4c9-48a2-bcab-3b79b889bc5b]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:01 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:02 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:02 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:02 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 Jun 23 16:13:02 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:02 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.775s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'} {{(pid=93590) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f0ed33-1cf1-43df-9435-2efd7403d4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976a8358-0243-4cb8-9c97-06f79594158c', 'volume_size': 1}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7bc861-da22-4862-8b80-ff6621d7891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:02 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Volume volume-976a8358-0243-4cb8-9c97-06f79594158c (976a8358-0243-4cb8-9c97-06f79594158c): created successfully Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7bc861-da22-4862-8b80-ff6621d7891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Flow 'volume_create_manager' (ce59ebdb-2028-4725-918f-f88f4e81dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:13:02 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-741230e7-d11c-4ccd-993e-ec578611babc tempest-SnapshotDependencyTests-1891415808 None] Created volume successfully. Jun 23 16:13:02 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0" returned: 0 in 0.959s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:02 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:02 devstack sudo[114147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0 Jun 23 16:13:02 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Creating offline snapshot 2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 of volume 976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2bad84-8db2-4715-844e-e39feb759c00]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:03 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:03 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:03 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-41a76276-6fc0-413a-8702-7de8d83d0ed0" returned: 0 in 0.778s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-41a76276-6fc0-413a-8702-7de8d83d0ed0" released by "delete_volume" :: held 1.794s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['6c2e4fa9-30a4-4188-9a30-7e1067708d33', '6b51abc8-4d5b-4190-9dbd-68c3c5e2aa29', 'cbbfaa0e-899c-480d-a9d1-a349228b5a0e', '5e69d2a8-1273-46d5-9055-acc5561f19dd'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:03 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:03 devstack sudo[114153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:03 devstack sudo[114153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-5e3dffcd-6e00-4577-a343-26ef13d8c89b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-5e3dffcd-6e00-4577-a343-26ef13d8c89b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-5e3dffcd-6e00-4577-a343-26ef13d8c89b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-5e3dffcd-6e00-4577-a343-26ef13d8c89b" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663cdc0-8367-42a1-bf1e-f33032d0a75d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:04 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b Jun 23 16:13:04 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:04 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.966s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 1G {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:04 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 1G Jun 23 16:13:04 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:04 devstack sudo[114153]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.793s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:04 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:04 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d094ab4a-81ff-4edd-9ca0-a55660fe4e62 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-41a76276-6fc0-413a-8702-7de8d83d0ed0-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:05 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b" returned: 0 in 0.889s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:05 devstack sudo[114169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b Jun 23 16:13:05 devstack sudo[114169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:05 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 1G" returned: 0 in 0.978s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976a8358-0243-4cb8-9c97-06f79594158c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:05 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976a8358-0243-4cb8-9c97-06f79594158c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:05 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:05 devstack sudo[114175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:05 devstack sudo[114175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:05 devstack sudo[114169]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-5e3dffcd-6e00-4577-a343-26ef13d8c89b" returned: 0 in 0.764s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:05 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-5e3dffcd-6e00-4577-a343-26ef13d8c89b" released by "delete_volume" :: held 1.723s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['066d666a-8d40-4791-869f-ea8a3a3a61c8', '106b464d-0cb4-4ca4-be40-21ed286752d8', '9b052719-d0a7-4ff6-9a3d-631d71bde0cc', '4356cda5-d309-4579-b953-8129ac694c47'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:06 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:06 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:06 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976a8358-0243-4cb8-9c97-06f79594158c -F qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 0.849s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:06 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 is being set with open permissions: ugo+rw Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:06 devstack sudo[114183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:06 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-9f6d7e60-d35f-4c94-91a9-dad8951d9209-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-9f6d7e60-d35f-4c94-91a9-dad8951d9209-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-9f6d7e60-d35f-4c94-91a9-dad8951d9209" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-9f6d7e60-d35f-4c94-91a9-dad8951d9209" acquired by "delete_volume" :: waited 0.054s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4deac9-d5bc-4513-822b-dcd1958f872d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:06 devstack sudo[114175]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.864s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG oslo_service.periodic_task [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] Running periodic task VolumeManager._thread_info {{(pid=93590) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread count: 29 {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 16:13:06 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-44c42b70-e3db-4680-94c7-2ddb6a4eef05 None None] thread info: [<_MainThread(MainThread, started 126427734143104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93590) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 16:13:06 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 Jun 23 16:13:06 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:07 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.910s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:07 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-126f3cf6-9289-4470-a811-17b937e48aa7 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-5e3dffcd-6e00-4577-a343-26ef13d8c89b-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:07 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 1.010s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:07 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info Jun 23 16:13:07 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:07 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209" returned: 0 in 0.939s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:07 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:07 devstack sudo[114195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209 Jun 23 16:13:07 devstack sudo[114195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:08 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info" returned: 0 in 0.779s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:08 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info is being set with open permissions: ugo+rw Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:08 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info Jun 23 16:13:08 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:08 devstack sudo[114195]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-9f6d7e60-d35f-4c94-91a9-dad8951d9209" returned: 0 in 0.721s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-9f6d7e60-d35f-4c94-91a9-dad8951d9209" released by "delete_volume" :: held 1.732s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['a077b598-939f-49d3-ac4b-5d1410b75caa', '53976b8a-1301-44b2-a994-e858dd3a2c7a', 'a2ac99d0-72ef-4c1a-9f99-8cadf8f22bca', 'd1fb9503-8399-4b00-ad6e-0ac1c087e843'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:08 devstack sudo[114201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:08 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-8c6196ec-1967-4f97-98a5-34fb7efb083a-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-8c6196ec-1967-4f97-98a5-34fb7efb083a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-8c6196ec-1967-4f97-98a5-34fb7efb083a" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-8c6196ec-1967-4f97-98a5-34fb7efb083a" acquired by "delete_volume" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8b7e56-a130-4289-8976-1acd44bd1063]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:08 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:09 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.info" returned: 0 in 0.787s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.504s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-cc29b67c-fa2b-42ca-b6d3-3940a616473a tempest-SnapshotDependencyTests-1891415808 None] Create snapshot completed successfully Jun 23 16:13:09 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a Jun 23 16:13:09 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:09 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.840s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:09 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-9318c346-f05e-4d7a-9940-5109f0d7b079 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-9f6d7e60-d35f-4c94-91a9-dad8951d9209-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:09 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a" returned: 0 in 0.827s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:09 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:09 devstack sudo[114210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a Jun 23 16:13:09 devstack sudo[114210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:10 devstack sudo[114210]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-8c6196ec-1967-4f97-98a5-34fb7efb083a" returned: 0 in 0.688s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-8c6196ec-1967-4f97-98a5-34fb7efb083a" released by "delete_volume" :: held 1.576s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.flows.manager.create_volume [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93590) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Flow 'volume_create_manager' (8f31129f-f959-4929-96ae-8743bed11691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a4b5e8-083d-4602-a88d-c308dc58cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a4b5e8-083d-4602-a88d-c308dc58cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce0dd11-5eba-4991-ac38-58471e2918a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1c0db0eb5d493b922fb0dbb50bb1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T14:13:10Z,use_quota=True,user_id='9dadf51564d848e4a650f5fce40c81c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9),volume_type_id=a9f8bfcc-c983-4f47-bbbd-cf3fb02439f9)' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf220ff-ebdd-4c2a-baf2-fdf8d566fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf220ff-ebdd-4c2a-baf2-fdf8d566fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d610d022-7a25-4163-9937-3e6a4521a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d610d022-7a25-4163-9937-3e6a4521a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bce0dd11-5eba-4991-ac38-58471e2918a2', 'volume_name': 'volume-bce0dd11-5eba-4991-ac38-58471e2918a2', 'volume_size': 1, 'snapshot_id': '2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572389b3-1017-4444-b03d-7daafa8dfe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572389b3-1017-4444-b03d-7daafa8dfe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9556762c-da87-49e3-8a64-b40d9c71529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:10 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Volume bce0dd11-5eba-4991-ac38-58471e2918a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bce0dd11-5eba-4991-ac38-58471e2918a2', 'volume_size': 1, 'snapshot_id': '2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17'} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-bce0dd11-5eba-4991-ac38-58471e2918a2" by "_create_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['9454cb8c-619d-4302-a099-fe45d25d5fde', '4ed25e45-0ad6-4c97-b2bb-136a971f52df', 'bfaf9b5e-39ca-4a51-b357-1ebff40a1013', '8c80412f-6c5c-42f1-9a5c-d194c46987f3'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-bce0dd11-5eba-4991-ac38-58471e2918a2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Creating volume bce0dd11-5eba-4991-ac38-58471e2918a2 from snapshot 2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Selected osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc as target Quobyte volume. {{(pid=93590) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" by "_copy_volume_from_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] snapshot: 2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17, volume: bce0dd11-5eba-4991-ac38-58471e2918a2, {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c86e1-de6d-4a25-9ce0-85a9f343a2c1]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:10 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:10 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:10 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:10 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:10 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-38094736-f321-4a05-be26-01e18c1ab5f6-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-38094736-f321-4a05-be26-01e18c1ab5f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-38094736-f321-4a05-be26-01e18c1ab5f6" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-38094736-f321-4a05-be26-01e18c1ab5f6" acquired by "delete_volume" :: waited 0.015s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b1415-6af0-46ce-84a4-0b15afede576]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:11 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 Jun 23 16:13:11 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:11 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.752s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:11 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-de67eebf-d759-4e7b-94f2-4b6a4065a197 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-8c6196ec-1967-4f97-98a5-34fb7efb083a-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:11 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 0.894s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976a8358-0243-4cb8-9c97-06f79594158c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Creating direct copy from snapshot {{(pid=93590) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a00e65-bbc5-4bba-b24f-6b169863feda]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:11 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:11 devstack sudo[114223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:11 devstack sudo[114223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:12 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6" returned: 0 in 0.826s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:12 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6 Jun 23 16:13:12 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:12 devstack sudo[114223]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.815s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG cinder.utils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Path /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 not found in is_blk_device check {{(pid=93590) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:12 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 Jun 23 16:13:12 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:12 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-38094736-f321-4a05-be26-01e18c1ab5f6" returned: 0 in 0.660s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-38094736-f321-4a05-be26-01e18c1ab5f6" released by "delete_volume" :: held 1.541s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['f2cde833-41a9-4e32-9b99-96be41976c85', 'd9a89e01-e1a6-4a1f-9340-4d245abe2953', 'a2fb6f3b-f5d5-4447-bffa-2f94577d2b20', 'b00d639c-a70b-45d4-9ef9-6e9f22f5f29b'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:12 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:12 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:12 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-b3854694-b510-4052-92b9-b9a2e753f8a8-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-b3854694-b510-4052-92b9-b9a2e753f8a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-b3854694-b510-4052-92b9-b9a2e753f8a8" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-b3854694-b510-4052-92b9-b9a2e753f8a8" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleting offline snapshot b3854694-b510-4052-92b9-b9a2e753f8a8 of volume 81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] snapshot_file for this snap is: volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d774db-26c8-4128-afec-9ddc91e8b986]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:13 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 1.064s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:13 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:13 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:13 devstack sudo[114249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 Jun 23 16:13:14 devstack sudo[114249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:14 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-2519b938-70d5-485a-8139-d547cc66cba3 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-38094736-f321-4a05-be26-01e18c1ab5f6-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:15 devstack sudo[114249]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8" returned: 0 in 2.082s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:15 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:13:15 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7280b-451d-46a2-8ef7-436b1bdc4535]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:15 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:15 devstack sudo[114257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b Jun 23 16:13:15 devstack sudo[114257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:17 devstack sudo[114257]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b" returned: 0 in 1.423s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:17 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 Jun 23 16:13:17 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:17 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2" returned: 0 in 5.410s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:17 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7519275-0c14-4f76-9dc4-08ce05329251]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:17 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:18 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:18 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:18 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8" returned: 0 in 1.086s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:18 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8 Jun 23 16:13:18 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:18 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b.b3854694-b510-4052-92b9-b9a2e753f8a8" returned: 0 in 0.639s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:18 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.992s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG cinder.image.image_utils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Image conversion details: src /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 {{(pid=93590) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 16:13:18 devstack cinder-volume[93590]: INFO cinder.image.image_utils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Converted 1024.00 MB image at 189.22 MB/s Jun 23 16:13:18 devstack cinder-volume[93590]: WARNING cinder.volume.drivers.remotefs [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 is being set with open permissions: ugo+rw Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-b3854694-b510-4052-92b9-b9a2e753f8a8" released by "_delete_snapshot" :: held 5.467s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" released by "delete_snapshot" :: held 5.527s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:18 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 Jun 23 16:13:18 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:18 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['058ae517-8891-46b1-a97a-5ca8e8e6793e', 'b357646f-29f7-49fd-9f64-49ec9744aec2', 'ffdf586c-6b65-4bee-ac35-a5069b9383e6', '2cac7638-8424-4854-b3f3-c1be439fe570'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Delete snapshot completed successfully. Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-3136a2e7-215a-4cbf-9eeb-ec74d24f27f4 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-b3854694-b510-4052-92b9-b9a2e753f8a8-delete_snapshot" released by "delete_snapshot" :: held 5.677s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:19 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2" returned: 0 in 0.665s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" released by "_copy_volume_from_snapshot" :: held 8.886s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-bce0dd11-5eba-4991-ac38-58471e2918a2" released by "_create_volume_from_snapshot" :: held 8.923s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.945s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9556762c-da87-49e3-8a64-b40d9c71529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce0dd11-5eba-4991-ac38-58471e2918a2', 'volume_size': 1, 'snapshot_id': '2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17'}' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44260e8d-61a8-4110-80b2-f4f654183b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 16:13:19 devstack cinder-volume[93590]: INFO cinder.volume.flows.manager.create_volume [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Volume volume-bce0dd11-5eba-4991-ac38-58471e2918a2 (bce0dd11-5eba-4991-ac38-58471e2918a2): created successfully Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44260e8d-61a8-4110-80b2-f4f654183b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93590) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Flow 'volume_create_manager' (8f31129f-f959-4929-96ae-8743bed11691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93590) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 16:13:19 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-0595b119-51bf-4442-a79c-ee562fa58a50 tempest-SnapshotDependencyTests-1891415808 None] Created volume successfully. Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-81efb797-a549-41ce-8fbc-6f51bbfbc08b-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-81efb797-a549-41ce-8fbc-6f51bbfbc08b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" acquired by "delete_volume" :: waited 0.016s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e6f13-a70d-4e0e-9749-d8422911b59d]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:19 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:20 devstack sudo[114279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b Jun 23 16:13:20 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-delete_snapshot" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" by "delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" by "_delete_snapshot" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Deleting offline snapshot 2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 of volume 976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] snapshot_file for this snap is: volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a38e3-f501-4b2d-8a3c-2dcba662cec0]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:20 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:20 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:20 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b" returned: 0 in 0.779s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:20 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:20 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b Jun 23 16:13:20 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:21 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-81efb797-a549-41ce-8fbc-6f51bbfbc08b" returned: 0 in 0.657s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-quobyte-81efb797-a549-41ce-8fbc-6f51bbfbc08b" released by "delete_volume" :: held 1.491s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:21 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 0.813s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.remotefs [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976a8358-0243-4cb8-9c97-06f79594158c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93590) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b162376-fc7b-48a3-8373-fc647cd1d303]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Created reservations ['dd88eb54-9780-410c-8672-0c3b584e0757', '90a2b75c-5aef-40c4-8747-5a8ad0c573d5', 'd520ad4d-501d-4580-b37f-ab0089fe7125', 'd7cdc2a0-a920-4bd1-883a-b4c4f66453eb'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:21 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:21 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:21 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:21 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:21 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:22 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.792s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:22 devstack sudo[114307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:22 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:22 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:22 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.766s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:22 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:22 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Deleted volume successfully. Jun 23 16:13:22 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-e586660a-c4c8-4afe-933c-b84e6a393002 tempest-CreateVolumesFromSnapshotTest-1573373371 None] Lock "cinder-81efb797-a549-41ce-8fbc-6f51bbfbc08b-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:23 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 0.842s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:23 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17 Jun 23 16:13:23 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:23 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:23 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c.2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" returned: 0 in 0.727s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17" released by "_delete_snapshot" :: held 3.304s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:23 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" released by "delete_snapshot" :: held 3.330s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Created reservations ['821822ec-7c70-48e0-8a18-f90640e69fe8', '7bc638a5-7098-4986-a90e-c360e2b94b5b', '13279940-b25f-45bd-9d11-0067c36ef7ef', 'f460c2ee-11f4-4e2f-bc16-8070083d7bc7'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:24 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Delete snapshot completed successfully. Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-d8dc324c-250d-40a9-9bfa-c23f72763af5 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-2b7bcb77-7c1f-4e1a-a1a9-fe1e84ae7d17-delete_snapshot" released by "delete_snapshot" :: held 3.523s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-976a8358-0243-4cb8-9c97-06f79594158c-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-976a8358-0243-4cb8-9c97-06f79594158c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" acquired by "delete_volume" :: waited 0.019s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e90d0-be29-432c-9370-36285e1f6e38]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:24 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:25 devstack sudo[114318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:25 devstack sudo[114318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:25 devstack sudo[114318]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.744s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:25 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:25 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c Jun 23 16:13:25 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:26 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-976a8358-0243-4cb8-9c97-06f79594158c" returned: 0 in 0.660s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-976a8358-0243-4cb8-9c97-06f79594158c" released by "delete_volume" :: held 1.462s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Created reservations ['93a68b83-9699-411b-b241-1f6688b3bcd4', '96f96b14-f9cf-432e-9348-7ca004db1d70', 'c374849d-c709-4bac-af9d-23ef35092898', 'a23f243a-bef3-45a9-b0ce-0db00d640436'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:26 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:26 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:26 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-bce0dd11-5eba-4991-ac38-58471e2918a2-delete_volume" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-bce0dd11-5eba-4991-ac38-58471e2918a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" by "delete_volume" {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" acquired by "delete_volume" :: waited 0.020s {{(pid=93590) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 16:13:27 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.713s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:27 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Deleted volume successfully. Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8a6971-fb02-4280-b8ad-0b6ae519d83a]: (4, 'qcow2') {{(pid=94820) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-fdce6283-2081-4a38-90b8-3c154971b58e tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-976a8358-0243-4cb8-9c97-06f79594158c-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:27 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 Jun 23 16:13:27 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:27 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2" returned: 0 in 0.754s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:27 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:27 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2 Jun 23 16:13:27 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:28 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c/volume-bce0dd11-5eba-4991-ac38-58471e2918a2" returned: 0 in 0.628s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-quobyte-bce0dd11-5eba-4991-ac38-58471e2918a2" released by "delete_volume" :: held 1.428s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG cinder.quota [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Created reservations ['d395453c-7d87-4e72-ae9f-80c5a39e8c9d', '1dab7ad3-ae4e-45e7-9800-1fcefa66bfb0', '137a6fb4-3f78-4ce2-b824-cd6cffae8b2e', '0623a0c1-fecf-4fd3-9aec-f62f5d235aa9'] {{(pid=93590) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc': None} {{(pid=93590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG cinder.volume.drivers.quobyte [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-432110f1-119d-4590-898e-3761ad078bdc'] {{(pid=93590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.lockutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 16:13:28 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 16:13:28 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c Jun 23 16:13:28 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 16:13:29 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 23 16:13:29 devstack cinder-volume[93590]: DEBUG oslo_concurrency.processutils [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8bbbaeab0afdaab8b3b6ada3a8b7d30c" returned: 0 in 0.653s {{(pid=93590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 16:13:29 devstack cinder-volume[93590]: DEBUG cinder.manager [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Notifying Schedulers of capabilities ... {{(pid=93590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 16:13:29 devstack cinder-volume[93590]: INFO cinder.volume.manager [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Deleted volume successfully. Jun 23 16:13:29 devstack cinder-volume[93590]: DEBUG cinder.coordination [None req-869f8b32-352b-4185-86fc-054ad6d37371 tempest-SnapshotDependencyTests-1891415808 None] Lock "cinder-bce0dd11-5eba-4991-ac38-58471e2918a2-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=93590) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 16:13:38 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=141,cinder:SELECT=96,cinder:INSERT=34,cinder:DELETE=10 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 16:13:39 devstack cinder-volume[93590]: DEBUG dbcounter [-] [93590] Writing DB stats cinder:UPDATE=146,cinder:SELECT=107,cinder:INSERT=40,cinder:DELETE=14 {{(pid=93590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}